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RANDOM VARIABLES 



SVANTE JANSON AND STEN KAIJSER 

Abstract. We define the A::th moment of a Banach space valued ran- 
, dom variable as the expectation of its fc:th tensor power; thus the mo- 

ment (if it exists) is an element of a tensor power of the original Banach 
space. 

We study both the projective and injective tensor products, and their 
relation. Moreover, in order to be general and flexible, we study three 
different types of expectations: Bochner integrals, Pettis integrals and 
Dunford integrals. 

One of the problems studied is whether two random variables with 
the same injective moments (of a given order) necessarily have the same 
projective moments; this is of interest in applications. We show that 
this holds if the Banach space has the approximation property, but not 
in general. 

Several sections are devoted to results in special Banach spaces, in- 
cluding Hilbert spaces, C{K) and _D[0, 1]. The latter space is non- 
separable, which complicates the arguments, and we prove various pre- 
liminary results on e.g. measurability in D[0, 1] that we need. 

One of the main motivations of this paper is the application to 
Zolotarev metrics and their use in the contraction method. This is 
sketched in an appendix. 



1. Introduction 

Let X be a random variable with values in a Banach space B. To avoid 
measurability problems, we assume for most of this section for simplicity 
that B is separable and X Borel measurable; see Section [3] for measurability 
in the general case. Moreover, for definiteness, we consider real Banach 
spaces only; the complex case is similar. 

If E < CO, then the mean EX exists as an element of B (e.g. as a 
Bochner integral ^ X d P, see Section [5]) . Suppose now that we want to define 
the A::th moments of X for some k ^ 2, assuming for simplicity E \\X\\^ < oo. 
If B is finite-dimensional, then the second moment of X is a matrix (the 
covariance matrix, if X is centred), and higher moments are described by 
higher-dimensional arrays of joint moments of the components. In general, it 
is natural to define the A;:th moment of X using tensor products, see Section^ 
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for details: X'^^ is a random element of the projective tensor product B®'', 
and we define the projective /c:th moment of X as the expectation EX®^ e 
j^(S)k (-vvhen this expectation exists, e.g. if E||Xp < oo); we denote this 
moment by E X^^. In particular, the second moment is E = E(X(x)X) e 
B§)B. 

An alternative is to consider the injective tensor product B'^^ and the 
injective k:th moment EX®'^ e B®^. 

Another alternative is to consider weak moments, i.e., joint moments of 
the real- valued random variables x*{X) for x* e B* (the dual space). The 
weak fc:th moment thus can be defined as the function 

(xt,...,4)-E(xt(X)...x|(X))eM, (1.1) 

assuming that this expectation always exists (which holds, for example, if 
E ll^ll'^ < oo). Note that the weak A;:th moment is a /c-linear form on B* . 

The purpose of the present paper is to study these moments and their re- 
lations in detail, thus providing a platform for further work using moments 
of Banach space valued random variables. In particular, we shall give suffi- 
cient, and sometimes necessary, conditions for the existence of moments in 
various situations. 

One example of our results on relations between the different moments is 
that, at least in the separable case, the weak k:ih moment is equivalent to 
the injective moment. (See Theorem l6.10l for a precise statement.) 

We study also the problem of moment equality: if y is a second random 
variable with values m. B, we may ask whether X and Y have the same /c:th 
moments, for a given k and a given type of moment. (Assume for example 
that E ||X||'^,E \Y\^ < cx) so that the moments exist.) This problem, for the 
second moment, appears for example in connection with the central limit 



theorem for Banach space valued random variables, see e.g. 4^, Chapter 10] 
where weak moments are used. (In particular, a B-valued random variable 
X is said to be pregaussian if E X = and there exists a Gaussian i?-valued 
random variable Y such that X and Y have the same weak second moments.) 
This problem is also important when proving convergence in distribution 
of some Banach space valued random variables using a Zolotarev metric, 
see Appendix |BJ (The Zolotarev metrics are, for example, often used when 
applying the contraction method for sequences of random variables with 
a suitable recursive structure, see e.g. Neiniger and Sulzbach [49]. This 
applications is one of the main motivations of the present paper.) 

As an example of results obtained in later sections, let us consider this 
problem of moment equality further. In particular, we want to compare the 
property that X and Y have the same k:th moment for the different types 
of moments. (For simplicity, we assume as above that E ||Xp,E \\Y\\^ < oo, 
so the moments exist.) 

Since the dual space of B®^ is the space of bounded /c-linear forms on B 
(see Section HI, it follows (by Section [5]) that the k:th. projective moments 
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E X®'^ and E Y®^ are equal if and only if 

Ea(X, =EQ(y, ...,y), aeL(5*-';R), (1.2) 

where L{B^;M.) denotes the space of bounded fc-linear forms on B. (See 
Corollary Em) 

Moreover, by the definition of weak moments, X and Y have the same 
weak A::th moments if and only if 

E(xt(X) • • • xl{X)) = E(xt(y) • • • xl{Y)), xt, . . . ,4 e B\ (1.3) 

We shall see (Corollary I6.12P that this holds if and only if the injective 
moments E X®'^ and E y®*^ are equal. 

For any x*, • • • , x| e B* , the mapping (xi, . . . , x^) >— > a^* (xi) • ■ ■ x|(xfc) 
is a bounded A:-linear form on B, and thus (jl.3p is a special case of ()1.2p . 
Consequently, (jl.2p (|1.3p . i.e., if X and y have the same projective 
moments, then they have the same weak (and injective) moments. Does 
the converse hold? (This question is of practical importance in applications 
of the contraction method, see Appendix |Bj) We show that this problem is 
non-trivial, and deeply connected to the approximation property of Banach 
spaces. (See Section [8] for definitions and proofs.) In particular, we have the 
following results. 

Theorem 1.1. If B is a separable Banach space with the approximation 
property and X and Y are random variables in B such that E E ||y||'^ < 
00, then (|1.2p and (|1.3p are equivalent, i.e., X and Y have the same pro- 
jective k:th moments if and only if they have the same weak k:th moments. 

Theorem 1.2. There exists a separable Banach space B and bounded ran- 
dom variables X and Y in B such that, for k = 2, ()1.3p holds but not 

mi- 

In Theorem 11.21 we may further require B to be reflexive. 

Note that all classical Banach spaces have the approximation property 
(for example, P, cq, LP{h), C{K), and any Banach space with a basis), and 
that counterexamples are notoriously difficult to find. In fact, the approxi- 
mation property was formulated and studied by Grothendieck [H, Hj], but 
it took almost 20 years until a Banach space without the approximation 
property was found by Enflo [2^. Hence, it is unlikely that such spaces will 
appear in applications, and Theorem 11.11 ought to apply to any separable 
Banach space B that will be used in practice. (Note, however, that the 
non-separable Banach space B{H) of bounded operators in a Hilbert space 
lacks the approximation property, see Szankowski [gH.) 

In applications, B is often a function space, for example C[0, 1]. In this 
case, we can weaken the condition for equality of moments further, by con- 
sidering only point evaluations in ()1.3p . This yields the following result, 
stated here more generally for C{K) where K is a compact metric space. 
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Theorem 1.3. Let B = C{K) where K is a compact metric space, and 
let X and Y be random variables in C{K) such that E||X||^, E||y||^ < oo. 
Then ()1.2p is equivalent to ()1.3p . and further to 

E(X(ii)---X(tfc)) =E(y(ti)---y(tfe)), ti,...,tkSK. (1.4) 

In this case it is thus enough to study joint moments of X{t), and the A;:th 
moment of X is described by the real-valued function E(X(ti) • • • Xitki) on 
. We shall further see that if /c = 2, the integrability conditions can be 
weakened to sup^g^ < and sup^g^ < (Theorem 111. 23p . 

Remark 1.4. A standard polarisation argument, as in the proof of Theo- 
rem [THiHl shows that (11.31) is equivalent to 

E(x*(X)^) = E(x*(y)'^), a;*eS*. (1.5) 

In other words, the weak A;:th moments of X and Y are equal if and only 
x*{X) and x*{Y) have the same k:th moments for every x* e B* . Hence 
we can use (II. 5|) instead of ()1.3p in the results above. In contrast, in ()1.4|) . 
it is essential to allow different ti, . . . ,tk and joint moments. 

We have so far, for simplicity, assumed that B is separable. The same 
definitions apply in the non-separable case, but there are then technical 
complications (concerning measurability) that complicate both statements 
and proofs, and our results are less complete in this case. 

The space -D[0, 1] is a non-separable Banach space that is important in 
applications. We treat £'[0,1] in detail in Sections [T3HT61 by special argu- 
ments we obtain essentially the same results as in the separable case. In 
particular, we shall see (Theorem 116. 13p that Theorem 11.31 holds also for 
B = D[0, 1], with the usual measurability condition in D[0, 1]. 

For the reader's convenience (and our own), we have in Section [2] collected 
some notation used in this paper, and in Sections [3H5] preliminaries on mea- 
surability, tensor products and integration in Banach spaces. (There are no 
new results in these sections.) 

The main definitions of the moments are given in Section [6l together 
with various results giving sufficient, and sometimes necessary, conditions 
for their existence. (Some simple examples are given in Section [71) We 
give simple sufficient conditions that are enough for many applications, but 
we also give more precise results. We try to be as precise as possible, and 
therefore we use three different types of integrability (Bochner, Pettis and 
Dunford, see Section [5]) in the definition of the projective and injective mo- 
ments, leading to six different cases that we treat in detail. (The multitude 
of cases may be bewildering, and contributes to the length of the paper. 
The reader is recommended to concentrate on separable Banach spaces and 
Bochner integrals at the first reading; this is enough for many applications. 
However, for e.g. applications to -D[0, 1], this is not enough which is one 
motivation for considering also Pettis and Dunford integrals.) 

The approximation property is defined and used in Section [8l 
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Sections [9Hl6] study special Banach spaces: Hilbert spaces in Section [U 
L^{^) in Section [TOl C{K) (where K \s a compact space) in Section [TT] (with 
emphasis on the separable case, when K is metrizable); co(5) in Section [12] 
(with emphasis on the non-separable case); and finally, as said above, -D[0, 1] 
in Sections [T3VI161 where Sections [T31115I contain various preliminary results 
on e.g. the dual space and maximal ideal space as well as measurability and 
separability of random variables in D[0, 1]. In these sections we give many 
results on existence of moments of the different types for random variables 
in these spaces. 

In the final two sections we consider the collection of moments of all 
orders. Section [T7] shows that, under certain conditions, the moments de- 
termine the distribution, and Section [18] treats the problem whether conver- 
gence of the moments for a sequence of random variables implies convergence 
in distribution. We give both positive and negative results. 

The appendices discuss two well-known constructions related to moments. 

Appendix|A] describes the construction of a Hilbert space (the reproducing 
Hilbert space) connected to a -B-valued random variable; we show that this 
is closely related to the injective second moment. 

Appendix [B] describes the Zolotarev metrics and their connection to pro- 
jective moments; as said above this is a major motivation for the present 
paper. 

Throughout we usually try to give as general results as possible. We also 
give various counterexamples showing limitations of the results, especially in 
the non-separable case; these (and many technical remarks) can be skipped 
at the first reading. Some open problems are stated explicitly or implicitly. 
(As is often the case with integration in Banach spaces, cf. e.g. [29] . the 
non-separable case is much more complicated than the separable case and 
several open problems remain.) 

For completeness we include some known results that we need, with or 
without proof; we try to give references in both cases, but omit them for 
some results or arguments that we regard as standard. (The absence of a 
reference thus does not imply that the result is new.) We believe that many 
other results are new. 

Acknowledgement. We thank Joe Diestel, Ralph Neininger, Oleg Reinov, 
Viggo Stoltenberg-Hansen and Henning Sulzbach for helpful comments. 

2. Notations 

We will use the following standard notations, usually without comment. 

L{Bi, . . . ,Bk; B') is the space of bounded fc-linear maps i?i x • • • x B^ 
B'. In particular, with B' = M, we have the space of bounded fc-linear forms. 
When Bi = ■■■ = Bk = B we also write L{B''; B'). 

B* denotes the dual space of the Banach space B, i.e., the space L{B;M) 
of bounded linear functionals B ^ M. x e B and x* e B* , we use the 
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notations x*{x) and {x*,x), or as synonyms. We write x* _L Bi, for 

a subset Bi ^ B, if {x* ,x} = for every x e Bi. 

We use several standard Banach spaces in our results and examples; for 
convenience we recall their definitions here. 

For any set 5 and p e [l,oo), £^{3) is the Banach space of all functions 
S* ^ M such that the norm ||/||£p(5') := (XisGS finite. (We are 

mainly interested in the cases p = 1, 2.) Further, is the Banach space 

of all bounded functions 5 ^ M, with the norm ll/l|^<=c(5) := sup^g^ 
We use sometimes the notation fs for f{s), in particular when 5 = N. 

We define the support of / as supp(/) := {s : /(s) ^ 0}, and note that if 
/ e ^^(5*), with p < CO, then supp(/) is countable even if S is uncountable. 

co(S') is the space of all function / : S" ^ R such that {s : \f{s)\ > e} is 
finite for each e > 0; this is a closed subspace of i'^, and is thus a Banach 
space with the inherited norm ||/||co(5) := '■= sup^gg Note 

that every element of 00(5") has countable support. 

Cs denotes the function es{t) := l{t = s} that is 1 at s and everywhere 
else (defined for t in some set S, which will be clear from the context). 

Let coo{S) be the space of all functions / : S — > M with supp(/) finite; 
this is the linear span of {sg : s e S} . Then Coo(»S') c 00(5*) c £^(^S), and 
coo{S) is dense in co{S). Hence co{S) is the closed linear span in £"(5) of 
the functions {e^ : s e 5}. It follows that 

cooisr = coisr = i\s), 

with the standard pairing {/, 5) = YiseS fi^)9i^)- 
When S* = N, we write just £^ and cq. 

LP{S), where S = {S, S, /i) is a measure space and p e [1, 00), is the space 
of all measurable functions / : — > M such that Jsl/I^ < ^ usual 
identifying functions that are equal a.e.). 

C{K), where if is a compact topological space, is the space of all con- 
tinuous functions f : K —>■ W, with the norm sup^ |/|. (We are particulary 
interested in C[0, 1].) 

For a compact set K, M{K) is the Banach space of all signed Borel 
measures on K. By the Riesz representation theorem, the dual C{K)* 
can be identified with the subspace MAK) of M{K) consisting^ of regular 
measures; see e.g. Theorem 7.3.5], jj^ . Theorem IV. 6. 3] or [13, Theorem 
III. 5. 7]. (If e.g. K is compact and metrizable, then every signed measure is 
regular, so C{KY = M{K), see [12, Propositions 7.1.12, 7.2.3, 7.3.3].) 

D[0, 1] denotes the linear space of functions [0, 1] — > M that are right- 
continuous with left limits, see e.g. 0, Chapter 3]. The norm is supp^i] |/|. 
See further Section [T3l 

dg denotes the Dirac measure at s, as well as the corresponding point 
evaluation / ^ /(s) seen as a linear functional on a suitable function space. 

(O, J^, P) denotes the underlying probability space where our random vari- 
ables are defined; uj denotes an element of fi. We assume that (17, J^, P) is 
complete. 
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We let E denote the upper integral of a, possibly non-measurable, real- 
valued function on Q: 

EY := inf{E Z : Z ^ Y and Z is measurable}. (2.1) 

(If Y is measurable, then KY = KY.) In particular, if X is i?-valued, then 
]E||X|| < 00 if and only if there exists a positive random variable Z with 
||X|| ^ Z and EZ < 00. 

The exponent k is, unless otherwise stated, an arbitrary fixed integer 
^ 1, but the case /c = 1 is often trivial. For applications, k = 2 is the most 
important, and the reader is adviced to primarily think of that case. 

3. Measurability 

A S-valued random variable is a function X : 0, ^ B defined on some 
probability space (fi, J-", P). (As said above, we assume that the probability 
space is complete.) We further want X to be measurable, and there are 
several possibilities to consider; we will use the following definitions. 

Definition 3.1. Let X : 0, ^ B he a function on some probability space 
(0, J^, P) with values in a Banach space B. 

(i) X is Borel measurable if X is measurable with respect to the Borel 
cT-field B on B, i.e., the cr-field generated by the open sets. 

(ii) X is weakly measurable if X is measurable with respect to the u-field 
Bw on B generated by the continuous linear functionals, i.e., if {rc*, X) 
is measurable for every x* e B* . 

(iii) X is a.s. separably valued if there exists a separable subspace Bi <^ B 
such that X e Bi a.s. 

(iv) X is weakly a.s. separably valued if there exists a separable subspace 
Bi<^B such that if x* e B* and x* 1 -Bi, then x*{X) = a.s. 

(v) X is Bochner measurable if X is Borel measurable and a.s. separably 
valued. 

Remark 3.2. X is Bochner measurable if and only if X is Borel measurable 
and tight, i.e., for every e > 0, there exists a compact subset K <^ B such 
that P(X e K) > 1 — e, see [g. Theorem 1.3]. (This is also called Radon.) 
Some authors use the name strongly measurable. Moreover, X is Bochner 
measurable if and only if there exists a sequence Xn of measurable simple 



functions VL^ B such that Xn ^ X a.s., see [22, III.2.10 and III.6. 10-14]. 
(This is often taken as the definition of Bochner measurable.) See further 
Hi, Chapter 2.1]. 

The name scalarly measurable is sometimes used for weakly measurable. 
Some authors (e.g. [l^]) let "measurable" mean what we call Bochner 
measurable, so care should be taken to avoid misunderstandings. 

If B is separable, there is no problem. Then every X is trivially a.s. 
separably valued; moreover, it is easy to see that B^ = B. Hence every 
weakly measurable X is measurable, and the notions in (i) , (ii) and (v) 



8 



SVANTE JANSON AND STEN KAIJSER 



are equivalent. This extends immediately to a.s. separably valued random 
variables in an arbitrary Banacli space: 

Theorem 3.3 (Pettis, (23 . III. 6. 10-11]). If X is a.s. separably valued, then 
X is Borel measurable (and thus Bochner measurable) if and only if X is 
weakly measurable. □ 

Remark 3.4. There is a converse, assuming some set theory hypotheses. 
(See further Remark 19.131 ) By [iH] (see also [51, Appendix III]), if the car- 
dinality of B is not real-measurable then every Borel measurable random 
variable in B is a.s. separably valued. It follows, in particular, that if the 
continuum hypothesis holds and furthermore there is no inaccessible car- 
dinal, then every Borel measurable random variable in any Banach space 
is a.s. separably valued. (These hypotheses are both consistent with the 
usual ZFC set theory; see further Remark 19.131 ) Hence, it can safely be 
assumed that every Borel measurable random variable that will appear in 
an application is a.s. separably valued. In other words, if we want to study 
random variables that are not a.s. separably valued, then we cannot use 
Borel measurability. 

In view of this, we prefer to use separable Banach spaces, or at least 
a.s. separably valued random variables, whenever possible. Many standard 
Banach spaces are separable, for example -^^[0, 1] {1 ^ p < go) and C[0, 1]. 
However, the non-separable space D[0, 1] (see Section [T3|) is important for 
applications, and it is easily seen (Theorem 115.111 below) that a D-valued 
random variable X is a.s. separably valued if and only if there exists a 
(non-random) countable set A cz [0, 1] such that X a.s. has all its points 
of discontinuity in A. In practical applications this means that a random 
variable X e D[0, 1] is a.s. separably valued if it has jumps at deterministic 
places, but not if there are jumps at random places. 

Example 3.5 (See @, Section 15]). Let U ~ U(0, 1) be a uniformly dis- 
tributed random variable, and let X be the random element of D[0, 1] given 
by X = l[;7,i], i-e. X{t) = 1{U ^ t}. (This is the empirical distribution func- 
tion of U, seen as a sample of size 1.) Since the functions l[n,i]) u e [0, 1], all 
have distance 1 to each other, they form a discrete subset of D[0, 1] and it 
follows that X is not a.s. separably valued. In particular, X is not Bochner 
measurable. 

Moreover, if A is a non-measurable subset of [0, 1], then the set {![«,!] : 
ti e ^} is a closed subset of D[0, 1], and thus a Borel set. If we take the 
probability space (Q, J^, P) where U and thus X are defined to be [0, 1] with 
Lebesgue measure, and U{uj) = u, then X~^{A) = A ^ T and, consequently, 
X is not Borel measurable in -D[0, 1]. (If we assume the continuum hypoth- 
esis, X cannot be Borel measurable for any probability space {Q,T,F), see 
Remark [331) 

On the other hand, X{t) is measurable for each t, and by Pestman [sH, 
see Corollary 113.21 and Theorem 115.51 below. X is weakly measurable. 
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Furthermore, it follows from [SlJ (or Corollary 113. 2p also that if x* e D* 
and X* _L C[0, 1], then = for all but countably many u; thus 

x*{X) = a.s. which shows that X is weakly a.s. separably valued. (Cf. 
Theorem 115.131 ) 

Cf. also [63, Example 3-2-2] which studies essentially the same example 
but as an element of L°°[0, 1]. 

Remark 3.6. If X is Borel measurable, then ||X|| is measurable, since 
X 1-^ ||x|| is continuous. However, if X only is weakly measurable, then ||X|| 
is not always measurable without additional hypotheses. (For this reason, 
we will sometimes use the upper integral ]E||X||.) If X is weakly measurable 
and a.s. separably valued, then ||X|| is measurable, e.g. by Theorem 13.31 (In 
particular, there is no problem when B is separable.) Furthermore, if B has 
the property that there exists a countable norm-determining set of linear 
functionals, then every weakly measurable X in B has measurable; 
D[0, 1] is an example of such a space. 

Remark 3.7. Several other forms of measurability may be considered, for 
example using the Baire cj-field (generated by the continuous functions B 



M) [64] or the cr- field generated by the closed (or open) balls in B [2Cll.l2ll|. 
Note further that, in general, is not the same as the cr-field generated 
by the weak topology. (In fact, Bw equals the Baire cr-field for the weak 
topology [13], [S^l-) When B is separable, all these coincide with the Borel 
cr-field. 



See also [23(], [2J], [43] and [6^, where further possibilities are discussed. 

4. Tensor products of Banach spaces 

We give a summary of the definitions and some properties of the two 
main tensor products of Banach spaces. We refer to e.g. Blei [8] or Ryan 



571 ] for further details. We consider the general case of the tensor product 
of k different spaces. The tensor products we consider (both algebraic and 
completed) are associative in a natural way; for example, i?i ® ® -B3 = 
{Bi ® B2) ® B^ = Bi® {B2 ® -B3), and the general case may be reduced to 
tensor products of two spaces. (Many authors, including [53], thus consider 
only this case.) 

4.1. Algebraic tensor products. The algebraic tensor product of a finite 
sequence of vector spaces -Bi , . . . , (over an arbitrary field) can be defined 
in an abstract way as a vector space i?i ® • • • (x) B/j with a /c-linear map 
Bi X ■ ■ ■ X Bk ^ Bi ® ■ ■ ■ ® Bk, written (xi, . . . Xk) ^ xi (g) • • • (x) x^, such 
that a a : Bi x • • • x B^ ^ A is any /c-linear map, then there is a unique 
linear map d : i?i (x) ■ • • ® B^ — > A such that 

a(xi,...,XA:) = a(xi(x)---(x)xfc). (4.1) 

(All such spaces are naturally isomorphic, so the tensor product is uniquely 
defined, up to trivial isomorphisms.) 
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Several concrete constructions can also be given. One useful construction 
is to let be the algebraic dual of Bi and define 5i® • • - 05^ as a subspace 
of the linear space of all A;-linear forms on S| x • • • x 5^; more precisely we 
define xi ® • • • ® Xfe as the fc-linear form on S| x • • • x 5| defined by 

xi ® • • • ® Xkix*, ...,xl)= x*{xi) ■ ■ ■ xl{xk), (4.2) 

and then define Bi0 ■ ■ ■ as the linear span of all ® • • • ® x^. 

We can modify this construction by replacing by any subspace that 
separates the points of Bi. In particular, when each Bi is a Banach space, 
we can regard Si ® • • • ® as a subspace of the space of fc-linear forms on 
B^ X ■■■ X B*. 

An element of -Bi®- • •®-Bfc of the form a;i®- • •®,Tfc is called an elementary 
tensor. Note that not every element of i?i® • • - ^B^ is an elementary tensor, 
but every element is a finite linear combination of elementary tensors (in a 
non- unique way). 

A sequence of linear operators Ti : Ai ^ Bi defines a unique linear map 
Ti ® • • • ® Tfc : yli ® • • • ® -> 5i ® • • • ® Sfe such that Ti ® • • • ® Tk{xi ® 
• • • ® Xk) = Tixi ® • • • ® TkXk for elementary tensors. 

4.2. Completed tensor products. When Bi, . . . ,Bk are Banach spaces, 
we can define several different (non-equivalent) norms on Si ® • • • ® 5^. For 

each norm we then can take the completion of i^i ® • • • ® B^, obtaining a 
Banach space. We consider two cases (the two main cases) of completed 
tensor products. 

The projective tensor norm is defined on Si ® • • • ® by 

:= inf (^2] Ikijllfii • • • \\xkj\\Bt, : « = ® • • • ® Xfe^^, (4.3) 

3 3 

taking the infimum over all ways of writing finite sum of elementary 

tensors. The corresponding completed tensor product is called the projective 
tensor product and is written i?i®---®i?fc. It is easily seen that every 
u e Si® • • • ®Sfe can be written (non-uniquely) as an absolutely convergent 
infinite sum of elementary tensors: for any e > 0, 

00 00 
M = 2 xij ® • • • ® Xfcj with 2 IIxijIIbi • • • llx/cjllsfe ^ (1 + £)|ltt|l7r < 00; 

3=1 3=1 

(4.4) 

equivalently, 

00 

u = ^ XjXij ® • • • ®Xkj with llxjjllBi ^ 1, Aj ^ and 

3 = 1 

00 

2 Aj s: (1 + e)|lw|l^ < c». (4.5) 

3=1 
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The injective tensor norm is defined on i?i (x) • • • (x) by using (14. 2p to 
regard i?i(x)- ■ •'^Bk as a subspace of L{B*, . . . , B^;R), the bounded fc-hnear 
forms on B* x • • • x B^, and taking the induced norm, i.e., 

Me ■.= sup{\u{xl,...,xl)\ : \\xI\\b*,. . . ,\\xI\\b* ^ 1). (4.6) 

The corresponding completed tensor product is called the injective tensor 
product and is written Bi0- ■ ■ ^Bj.; note that this is simply the closure of 
Bi ® ■ ■ ■ ® Bk in L{Bf, . . . , i?^; M) and thus can be regarded as a closed 
subspace oi L{B^ , . . . , B^;R). 
For elementary tensors we have 

\\xilS)---lS)Xk\\n = |kl®---®a;fc||£ = \\xi\\bi ■■■ \\xk\\Bk: (4-7) 

so the two norms coincide. (Any such norm on i?i (g) • • • ® 2?^ is called a 
crossnorm.) Moreover, it is easily seen that for any u e -Bi ® • • • (x) -B^, 
Wu-We ^ II'^^IItt; hence the identity map u>—>-u extends to a canonical bounded 
linear map (of norm 1) 

L : Bi§) ■ ■ ■ §)Bk Bi0 ■ • • (4.8) 

with ||i|| ^ 1. Unfortunately, this map is not always injective; we return to 
this problem in Section [HI where we shall see that this is the source of the 
difference between (|1.2p and (|1.3p . 

Consider for simplicity the case k = 2. As said above, i?i(g)i?2 can be 
seen (isometrically) as a subspace of L(i?*, R). Moreover, an elementary 
tensor xi®X2 defines a bounded linear operator B* B2 by x* t-^ x*[xi)x2, 
and this extends by linearity to a mapping i?i g) i?2 — >■ L(B*; B2), which is 
an isometry for the injective tensor norm (j4.6p . Hence, this mapping extends 
to an isometric embedding of Bi^B2 as a subspace of the space L{B*; B2) 
of bounded linear operators B^ — > -62- Explicitly, u e Bi^B2 corresponds 
to the operator : B* ^ B2 given by 

(T^x*,y*) = <x* ®y*,n>, e B^, e Bl (4.9) 

(By symmetry, there is also an embedding into L{B2; Bi). If n e Bi^B2 
corresponds to the operator T„ : B* — ► ^2) it also corresponds to T* : B2 
Br.) 

When the mapping i in (j4.8p (with A; = 2) is injective, we may regard 
Bi§)B2 as a subspace of Bi^B2 (with a generally different, larger, norm); 
hence B10B2 may be regarded as a certain space of operators B* B2 in 
this case too. 

Example 4.1. Suppose that Bi, . . . , B^ are finite-dimensional, and let {eij}j, 
J e J7i, be a basis of Bi for i = 1, . . . ,k. It is easily seen that the elementary 
tensors ej := eij^ (x) • • • (x) ekj^., with J := (jj)j e Y\i=i form a basis of 
-Bi(x)...®Sfe. 

Hence dim(5i ® • • • (x)^^) = \\i^^^im{Bi) < 00. In particular, the tensor 
product is complete for any norm, and thus B\® ■ ■ ■ ®Bk = -Bi® • • • ®Bk = 
-Bl (X) • • • ® -Bfc as sets (although the norms generally differ) . 
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Using the basis (ej) j, any element of the tensor product may be written 
as J^jajej, where the coordinates aj are indexed by J e Y[i=i s° is 
natural to consider the coordinates as a /c-dimensional array. (A matrix in 
the case k = 2.) 

Example 4.2. Let H he a Hilbert space. The tensor products Hi^H and 
H^H can be identified with the spaces of trace class operators and compact 
operators on H, respectively, see Theorem l9.2| moreover, H0H = {H^H)*. 

In this case, another interesting choice of norm on 110 H is the Hilbertian 
tensor norm, given by the inner product (a^i ®X2, yi ®y2) = {xi,yi}{x2, 1/2)', 
the corresponding completed tensor product H H can be identified with 
the space of Hilbert-Schmidt operators on H. (We will not use this tensor 
product in the present paper.) 

If Ti : Ai ^ Bi are bounded linear operators, then Ti®- • -^T^ is bounded 
for both the projective norms and the injective norms, and extends thus 
to bounded linear maps Ti® • • • (x)Tfe : Ai® • • • ®ylfc — > Si® • • • ®-Bjt and 
Ti® • • • : Ai® • • • ®74fc i^i® • • • ®i3fe. We note the following lemma, 
which we for simplicity state for the case k = 2, although the result extends 
to general k. 

Lemma 4.3. If T : Ai ^ Bi and U : A2 — > i?2 CLfc injective linear operators 
between Banach spaces, then T^U : A10A2 -Bi®i?2 is injective. 

Proof. Consider first the case when Ai = Bi and T = I, the identity op- 
erator. We can regard Ai^A2 and Ai®52 as subspaces of L{A*;A2) and 
L{A^; B2) , and then /®[/ is the mapping L{A\;A2) L{Al\B2) given by 
S 1— » US, which is injective when U is. 

In general we factorize T0U = (T®/)(/®C/) and note that both factors 
T®/ : Ai^B2 ^2®-B2 and J® [/ : Ai^Bi Ai^B2 are injective by the 
first case and symmetry. □ 

Remark 4.4. The same proof shows that if T and U are isometric em- 
beddings, then so is T0U. (In other words, the injective tensor product is 
injective Section 6.11.) 

Remark 4.5. Lemma 14.31 is in general not true for the projective tensor 
product, see Example 18.71 and Remark 18.81 

The projective tensor product has instead the dual property that if T and 
U are quotient mappings (i.e., onto), then so is T0U. 

When considering the dual space of a completed tensor product, note that 
-Bi ® • • • ® -Bfc is a dense subspace (by definition) ; hence a continuous linear 
functional is the same as a linear functional on i?i®- • •®i?fc that is bounded 
for the chosen tensor norm. Furthermore, each such linear functional can by 
(14. ip be identified with a A;-linear form on i?i x • • • x Bj.. For the projective 
tensor product, the definition (14. 3j) of the norm implies that all bounded 
fe-linear forms yield bounded linear functionals. 
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Theorem 4.6 ((13, Theorem 2.9]). The dual iBi§) ■ ■ ■ §)Bk)* consists of 
all bounded k-linear forms Bi x • • • x Bk with the natural pairing 

(a,xi(S)- ■ ■ '8)Xk) = a{xi,. . . ,Xk). □ 

For -Bi®- ■ ■(S)Bk, the dual space consists of a subset of all bounded k- 
linear forms; these forms are called integral, and can be described as follows. 
Let Ki be the closed unit ball of Bf with the weak* topology; thus Ki is a 
compact space. 

Theorem 4.7 ([H^, Proposition 3.14]). If x ^ (Bi^ ■ ■ ■ ^B^)* , then there 
exists a (non-unique) signed measure n e M[Ki x • • • x K^), with = \\x\\, 
such that 

x(a;i®---®Xfc) = xl{xi)---xl{xk)d^i{xl,...,xl). (4.10) 

JKlX■■■xK^: 

Conversely, ()4.10p defines a bounded linear functional for every signed mea- 
sure fj, e M{Ki X • • • X Kk). 

Proof. We have defined an embedding of i?i (x) • • • ® -B^ in L{B*, . . . , i?^; R) 
by ()4.2p , and taking the restriction of the operators to Ki x • • • x gives 
a linear map into C{Ki x • • • x Kk), which by the definition (|4.6p of the 
injective tensor norm is an isometry. Hence we can regard Si® • • • ®Bk as 
a subspace of C{Ki x • • • x Kk), and the result follows by the Hahn-Banach 
theorem together with the Riesz representation theorem. □ 

An elementary tensor x* ® • • • ® e B* ® ■ ■ ■ ® defines a fc-linear 
form on i?i X • • • X by (xi, . . . ,Xfc) t-> x*(xi) ■ ■ ■ x^(xfc), and thus a linear 
functional on i?i ® • • • ® Bk by 

<x* ® • • • ® x^, xi ® • • • ® Xfc> = x*(xi) • • • x^(xfc). (4.11) 

By the definitions above, see (j4.6p and (j4.2p . this linear functional extends 
to a linear functional on Si® • • • ®Bk of norm ||x* || ■ • • ||x^ || , and it follows by 
(j4.3p . linearity and continuity that every tensor n* e i?*® • • • ®-B^ defines a 
linear functional on Si® - • • ®S/c with norm at most 11^*11,^, i.e., an integral 
form on Si X • • • X Sfc. In fact, by ()4.4p . the forms obtained in this way are 
exactly the integral forms such that there is a representation (I4.10|) with a 
discrete measure ^. These forms are called nuclear forms on Si x • • • x S^. 
By ()4.5p . every nuclear form can be written as 

X=i;A,xt,®---®x|^. (4.12) 

i=i 

with \j ^ 0, Xijli < 00 and ||x*-l| ^ 1. 

Remark 4.8. Let X(Si, . . . , B^) and Af{Bi, . . . , S^) be the spaces of inte- 
gral and nuclear forms, respectively, on Si x • • • x Bk- Both I(Si, . . . , S^) 
and A/'(Si, . . . ,Sfc) are Banach spaces (with the natural norms suggested 
by their definitions, see [13]), and there is an inclusion AA(Si, . . . ,Sfc) 
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X{Bi, . . . ,Bk) with the inclusion mapping having norm at most 1. Fur- 
thermore, there is a quotient mapping B*® ■ ■ ■ ®B^ J\f{Bi, . . . , Bk). In 
general, none of these maps is an isomorphism, but there are important 
cases when one or both are. 

Remark 4.9. When k = 2 (bilinear forms), there are corresponding notions 
for linear operators. 

We say that an operator T : Bi ^ B2 is integral if the corresponding 
bilinear form on Bi x i?| given by {x, y*) i— > (Tx, y*} is integral. Conversely, 
a bilinear form a : Bi x i?2 ^ M is integral if and only if the corresponding 
operator T : Bi —>■ i?| given by (Tx, y) = a{x, y) is inte gral . (When B2 
is reflexive, these are obviously equivalent. In general, see [571, Proposition 
3.22].) 

Similarly, an operator T : Bi ^ B2 is nuclear if {Tx, y*) = (u, x ® 
y*) for some u e B*®B2. When B2 is reflexive, this says precisely that 
corresponding bilinear form on Bi x i?| given by {x,y*) ^ (Tx,y*y is 
nuclear. 



5. Vector-valued integration 



We summarize the definitions of the main types of vector- valued integrals, 
see e.g. 22], 18], [13] and [H?] for details. In order to conform to the rest 



of this paper, we use probabilistic language and consider the expectation 
of a -B-valued random variable X. (The definitions and results extend to 
integrals of Banach space valued functions defined on arbitrary measure 
spaces with only notational changes.) 

The Bochner integral is a straightforward generalization of the Lebesgue 
integral to Banach space valued functions. We have the following character- 
ization [13, III.2.22 and III.6.9], cf. Theorem ESI 

Theorem 5.1. A random variable X : (17, J^, P) B is Bochner integrahle 
if and only if X is Bochner measurable and E ||X|| < oo. □ 

As discussed in Section [3l Bochner measurable variables are not enough 
for all applications. For a more general integral, suppose only that x*{X) 
is integrable for every x* e B* . (In particular, X is weakly measurable.) 
Then the linear map 

Tx:x*^x%X) (5.1) 

maps B* into L^(P) and by the closed graph theorem, this map is bounded. 
Hence x* ^ Ex*(X) = S^x*{X) dP is a bounded linear map B* M, i.e., 
an element of B** . This element is called the Dunford integral of X. We 
can write the definition as 

(EX,x*) = E(x*,X}, (5.2) 

noting that in general EX e B** . 

In the special case that the Dunford integral EX e B, and moreover 
(see Remark 15. 3p E{X\e) £ B for every event E (i.e., every measurable set 
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c we say that EX is the Pettis integral of X. Note that the Pettis 
integral by definition is an element of B. If X is Bochner integrable then 
it is Pettis integrable (and Dunford integrable) and the integrals coincide, 
but the converse does not hold. The examples below show that a Pettis 
integrable function may fail to be Bochner integrable because of either in- 
tegrability or measurability problems. (Talagrand [sl, Chapter 5] and [s^ 
give characterisations of Pettis integrability, but they are not always easy 
to apply; it seems that there is no simple necessary and sufficient condition. 



See further e.g. [2j] and [3 



Remark 5.2. If B is reflexive, i.e. B** = B, then every Dunford integrable 
function is trivially Pettis integrable (and conversely). However, we will not 
find much use of this, since we will take integrals in tensor products i?®'^ 
or see Section [6l and such tensor products are typically not reflexive, 

even if B is reflexive, see for example Theorem 19. 2^ Example 17.21 and, more 
generally, [sj, Section 4.2]. 

Remark 5.3. Suppose that X is Dunford integrable. Then ^X is Dunford 
integrable for every bounded random variable ^, i.e., for every ^ e L°°(P). 
Moreover, the adjoint of the bounded linear map Tx '■ B* —>■ L^(F) given by 
([MD is the map : L°°(P) B** given by 

TU = mX). (5.3) 

By definition, X is Pettis integrable if K{X1e) e B, i.e., if T^(1e) e B, 
for every measurable set E; since the simple functions are dense in L°°(P), 
this is equivalent to T^{C) = e B for every ^ e L°°(P). Hence, X is 

Pettis integrable if and only if : L=°(P) ^ 

Remark 5.4. It follows that if X is Dunford integrable, then X is Pettis 
integrable if and only if Tx '■ B* — > L^(P) is weak*-weak continuous. (If 
X is bounded, then Tx is always sequentially weak*-weak continuous by 
dominated convergence; this is not enough, as shown by Examples 15.191 
and [1123) 

Remark 5.5. It follows easily from (|5.2p that if X is Dunford integrable 
and ^ e L=°(P), then E(^X) = E(^iX) where := E(^ | Tx), where Tx 
is the sub-cr-field of J- generated by all x* e B*. Hence, X is 

Pettis integrable if and only if E(^iX) e B for every J-x-measurable ^i. 
Each such is a Borel function of a countable family [(^x* , Xy)i. It follows 
that the question whether X is Pettis integrable or not depends only on the 
distribution of X (or equivalently, the joint distribution of (x*, X), x* e B*) 
and not on the underlying probability space (O, J-", P). 

Remark 5.6. If X is a i3-valued random variable and B is a closed subspace 
of another Banach space Bi, then X can also be seen as a -Bi-valued random 
variable. It is easily verified (using the Hahn-Banach theorem) that X is 
Bochner, Dunford or Pettis integrable as a -B-valued random variable if and 
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only if it is so as a -Bi -valued random variable, and the expectations EX in 
B and Bi coincide in all cases. 

By the definition (and discussion) above, X is Dunford integrable if and 
only if X* ^ x*(X) is a bounded linear operator B* L^(P). If X is Pettis 
integrable, then furthermore this operator is weakly compact, i.e., it maps 



the unit ball into a relatively weakly compact subset of L^(P), see 64], 361] 
or [57I . Proposition 3.7]. A subset of L^(P) is relatively weakly compact if 
and only if it is uniformly integrable, see [22, Corollary IV. 8. 11 and Theorem 
V.6.1], where we recall that a family {^q,} of random variables is uniformly 
integrable if 

jsup^E]^^] < 00 and 
|sup„E(lB]ea]) ^0 as F{E)^0, 



see e.g. [34l . Section 5.4] or [38, Lemma 4.10]. This yields the following 



necessary condition. 

Theorem 5.7. If X is Pettis integrable, then the family : x* e 

B*, \\x*\\ ^ 1} of (real-valued) random variables is uniformly integrable. □ 



The converse does not hold, see Examples 15.191 and 111.281 but Huff [36 
has shown that it holds if X is weakly a.s. separably valued. (In particular, 
the converse holds when B is separable.) 



Theorem 5.8 (Huff [36[). If {x*{X) : x* e B* , \\x*\\ ^ 1} is uniformly 
integrable and X is weakly a.s. separably valued, then X is Pettis integrable. 

□ 

Remark 5.9. Actually, Huff l3g] uses a condition that he calls separable- 
like; the definition given in ^36(] is somewhat stronger than weak a.s. sepa- 
rability, but it seems likely that he really intended what we call weak a.s. 
separability, and the proof in [3^ uses only weak a.s. separability. See 
also Stefansson [59|] where weakly a.s. separably valued is called determined 
by a separable subspace and said to be the same as Huff's separable-like. 
(Stefansson [s^ . Theorem 2.8] has extended Theorem 15.81 by weakening the 
condition of weak a.s. separability, replacing separable by weakly compactly 
generated, but we shall not use his results, which seem more difficult to 
apply in our situation.) 

Corollary 5.10. If X is weakly measurable and weakly a.s. separably valued, 
and further E,\\X\\ < cc, then X is Pettis integrable. 

Proof. There exists a measurable real- valued Z with ||X|| ^ Z and E Z < 00. 
If ||x*|| ^ 1, then \x*{X)\ ^ ||X|| ^ Z, and thus {x*{X) : x* e B* , ||x*|| ^ 1} 
is uniformly integrable. □ 

Remark 5.11. Let 1 < p ^ oo and assume that x*{X) e L^(P) for every 
X* e B*, i.e., that the map Tx : B* ^ L^{¥) above maps B* into LP(P). 
Then Tx : -B* — > -LP(P) is bounded by the closed graph theorem and thus 
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the adjoint T^, defined in Remark 15 .31 as an operator L'"(P) B**, extends 
to L'^{P), where q e [1, cxd) is the conjugate exponent given by 1/q = 1. 

Furthermore, (15. Sp holds for every S, e L''(P); note that x*{^X) = ^x*{X) e 
L^(P) by Holder's inequality so is Dunford integrable. 

If furthermore X is Pettis integrable, then : L°°(P) B hy YLq- 
mark lS^ and by continuity this extends to : L''(P) — > B. 

Note that if C is the norm of Tx : B* ^ L?'(P), then for every x* e 
B* with ||x*|| ^ 1, E|x*(X)|P = E|rx(x*_)JP ^ C^, which implies that 
: ||x*|| ^ 1} is uniformly integrable [34l . Theorem 5.4.2]. Hence, by 
Theorem 15.81 if furthermore X is weakly a.s. separably valued, in particular 
if B is separable, then X is Pettis integrable. 

Example 5.12. The standard Brownian motion (the Wiener process) W{t) 
is a random variable with values in C[0, 1]. is easily seen to be Bochner 
measurable (cf. Corollarv I11.15P and EUl^/^H < oo; thus W is Bochner inte- 
grable (and thus Pettis integrable). The operator Tx ■ C[0, 1]* = M[0, 1] 
L^(F) is given by 

Txifi) := </i, W) = C W{t) dfi{t). (5.5) 
Jo 

Tx obviously maps C[0, 1]* LP(F) for any p < co, since W dfi is Gauss- 
ian. (In fact, E \\W\\P < oo when p < oo.) The adjoint map : L'?(P) B, 
which by Remark 15.111 is defined for every q > 1, maps a random variable 
^ e L^(P) to the function in C[0, 1] given by 

= (St,T^O = <Tx6t,0 = (Wit),0 = E{CWit)). (5.6) 
Hence, ()5.3p says that 

E{^W){t)=E{^W{t)). (5.7) 
In particular, KW = 0, as is obvious by symmetry. 

We also state another sufficient condition for Pettis integrability that only 
applies in special Banach spaces. 

Theorem 5.13 toiestel and Uhll [H, Theorem II. 3.7]). Suppose that X 



IS 

Dunford integrable and a.s. separably valued, and that B does not contain a 
subspace isomorphic to cq. Then X is Pettis integrable. □ 

Example 15.141 below shows, using Remark 15.61 that the condition on B 
in Theorem 15.131 also is necessary. (Hence, in some sense. Example 15.141 
is the canonical example of a Dunford integrable variable that is not Pet- 
tis integrable, at least in separable spaces where there is no measurability 
problem.) 

Example 5.14. Let be a positive integer- valued random variable, and 
consider the random variable X := a^eN in cq, where e cq is the n:th 
vector in the standard basis and a„ are some real numbers. Let pn '■= f{N = 
n). It is easily seen that then 
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(i) X is Bochner integrable if and only if Xijf=i IPn^nl < co. 

(ii) X is Dunford integrable if and only if sup IpnOnl < co. 

(iii) X is Pettis integrable if and only if PnO-n — > as n — > oo. 

The integral EX equals {pnan)n^i in all cases where it is defined. (Thus, 
when X is Dunford integrable, EX e = Cq* but in general EX does not 
belong to cq.) 

Example 5.15. Let X := aj^jCN as in Example 15. 14^ but now regarded as 
an element oi B = It is easily seen that then 

(i) X is Bochner integrable if and only if Xin^i IPn^nl < co. 

(ii) X is Pettis or Dunford integrable if and only if Yin=i IPn'^nP < 
(There is no difference between Dunford and Pettis since B is reflexive.) 

The integral EX equals {pnan)n=i in all cases where it is defined. 

Example 5.16. Let again X := a^eN as in Example l5.14| but now regarded 
as an element of i? = Li this case, 

(i) X is Bochner integrable X is Pettis integrable X is 

Dunford integrable Xl^=i IPnOnl < go. 

In fact, let x* = (sign(a„))5° e = {tf . Then <x*,X> = |oiv|, so if X is 
Dunford integrable, then E|aiv| < oo, which implies Bochner integrability. 
The integral EX equals {pnan)n=i- 

Example 5.17. Examples 1 5. 141(5.161 are examples of the following general 
fact: Let X be a positive integer-valued random variable, with V{N = n) = 
Pn, let {xn)n^i be a sequence in a Banach space B, and let X := xn- It 
is then easy to see the following characterizations, see e.g. (stI . Proposition 
3.12 and Appendix B] and [13, Chapter IV and p. 44]. 

(i) X is Bochner integrable if and only if Xl^=i PnXn converges abso- 
lutely. 

(ii) X is Pettis integrable if and only if Yin^iPn^n converges uncondi- 
tionally. 

(iii) X is Dunford integrable if and only if the series Xl^^i PnXn is weakly 
unconditionally Cauchy. 

(This example is perhaps clearer if we do not restrict ourselves to probability 
measures, and regard Xi^=i as the integral of the function n ^ Xn defined 
on N equipped with counting measure. The sum converges as a Bochner 
integral, Pettis integral or Dunford integral if and only if it is absolutely 
summable, unconditionally summable or weakly unconditionally Cauchy, 
respectively.) 

Example 5.18. Let B = D[0,1], and let, as in Example 13. 5( X be the 
random element of D[0, 1] given by X = l[;7,i], where U ~ U(0, 1). Then 
X is not a.s. separably valued and thus not Bochner measurable; thus EX 
does not exist as a Bochner integral. (X is also not Borel measurable, at 
least typically, see Example 13.51 ) 
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On the other hand, it fohows from Theorem 1 1 5 . 5 1 that X is weakly measur- 
able, and since X is bounded, it is Dunford integrable. It is easily verified, 
using Corollary 113.21 and Fubini's theorem, that if x* e D*, then 

E(x*,X} = <x*,t>, 

where t denotes the identity function t ^ t. Hence the Dunford integral 
EX = t e Z)[0, 1]. It is similarly seen that if E is any event, then the 
Dunford integral E(X1e) is the function t >— > P({C/ ^ t} n E), which is 
continuous and thus belongs to D. Hence, X is Pettis integrable. 

By Remark 15. 6^ X is also Pettis integrable as a random variable in 
L°°[0, 1], since the hyperplane {/ e L>[0,1] ^(1-) = /(I)} m I)[0,1] also 
can be seen as a subspace of L°°[0, 1]. (Cf. [63, Example 4-2-4a)].) 

To find examples of bounded Dunford integrable random variables that 
are not Pettis integrable is more difficult and technical. Note that by The- 
orem 15.81 such random variables cannot be weakl y a .s. separably valued. 
We give one example from Fremlin and Talagrand j29|, omitting the (quite 
complicated) details. See Example 1 11 . 28 1 for another example. 

Example 5.19 (Premlin and Talagrand Q). Let Q = {0,1}"° with the 
infinite product measure /i = (^^o + (this is the Haar measure if we 

regard Vl as the compact group 'Lf), and let X : ^ be the inclusion. 
Then X is a random variable with values in (.^ such that the coordinates 
Xn are i.i.d. Be(l/2). It is shown in (29| and (g^ . Chapter 13] (by slightly 
different arguments) that X is not weakly measurable on $7 (with the prod- 
uct C7- field = the Borel u-field), but that the measure can be extended to 
a larger cr-field making X weakly measurable. More precisely, it is easily 
seen that (£*)* = 4, and if e c (^")* is given by (a„)f e £\ 
then x*[X) = anX^ where Xn as said above are i.i.d. Be(l/2); clearly 
x*{X) is measurable in this case. The extension of ^ constructed in [29(] 
and [62l ] is such that x*{X) is a.s. constant if x* e Cg . Hence x*{X) is 
measurable in this case too, and by linearity for every x* e (^°°)*, so X is 
weakly measurable. Moreover, the extension is such that in the particular 
case that multiplicative linear functional, x*(X) = 1 a.s. 

Consequently, using this extension of ^, X is bounded and weakly mea- 
surable, and thus Dunford integrable. However, if X had a Pettis integral 
y = EX e then ?/„ = EX„ = ^ for each n, since X„ ~ Be(^), and thus 
y = (^,^,...). However, if j;* is a multiplicative linear functional in Cq, 
then x*{y) = Ex*(X) = 1, a contradiction. Consequently, X is not Pettis 
integrable. 

By Theorem 15.81 ^ is not weakly a.s. separably valued. 

To summarize, we have defined three types of integrals. The Bochner in- 
tegral is the most convenient, when it exists, but the requirement of Bochner 
measurablility is too strong for many applications in non-separable spaces. 
The Pettis integral is more general, and will be our main tool in such cases; 
it also requires only a weaker integrability condition. The Dunford integral 
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is even more general, but in general it is an element the bidual B** instead 
of B, which makes it less useful. 

Note also that all three integrals are linear and behave as expected under 
bounded linear operators: If T : i? — > i^i and X is integrable in one of these 
senses, then TX e Bi is integrable in the same sense, and E(TX) = T(KX) 
{E{TX) = T**{EX) for Dunford integrals). 

Remark 5.20. It can be shown that the space of Bochner integrable B- 
valued random variables equals L^(P)®i? [st', Example 2.19], while L^(P)(g)i? 
is the completion of the space of Bochner measurable Pettis integrable B- 
valued random variables 57|, Proposition 3.13]. (If B is separable, this is by 
Theorem 13.31 just the completion of the space of Pettis integrable random 
variables; typically the latter space is not complete, so it is necessary to take 
the completion.) 

Remark 5.21. There are several further definitions of integrals of Banach 
space valued functions, see for example 0], [IH], [11], although only some 
of these definitions work on a general probability space as required here 
(for example the Birkhoff integral that lies between the Bochner and Pettis 
integrals). These integrals too could be used to define moments as in the 
next section, but we do not know of any properties of them that make them 
more useful for our purposes than the three integrals defined above, so we 
do not consider them. 



6. Moments 

If is a Banach space and X is a i?-valued random variable, defined on 
a probability space ($7,7-", P), and further A; is a positive integer, we define 
the projective k:th moment of X as the expectation KX®^ = ^X®^dF 
whenever this expectation (integral) exists in the projective tensor product 
B'^^. The expectation can here be taken in any of the three senses defined in 
Section m hence we talk about the moment existing in Bochner sense, Pettis 
sense or Dunford sense. Note that if the A;:th moment exists in Bochner or 
Pettis sense, then it is an element of B'^^, but if it exists in Dunford sense, 
then it is an element of (iJ®'^)** and may be outside B®^. 

Similarly, we can regard X'^^ as an element of the injective tensor product 
B®^ and take the expectation in that space. We thus define the injective 
k:th moment of X as the expectation EX®'^ = J-^^'^dF whenever this 

expectation (integral) exists in the injective tensor product B®''. Again, 
this can exist in Bochner sense, Pettis sense or Dunford sense; in the first 
two cases it is an element of B'^^, but in the third case it is an element of 

Example 6.1. The first moment (projective or injective; there is no differ- 
ence when A; = 1) is the expectation EX, which is an element of B when it 
exists in Bochner or Pettis sense, and an element of B** when it exists in 
Dunford sense. The examples in Section [5] show some cases. 
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We may for clarity or emphasis denote X®'^ by X'^^ when we regard it 
as an element of 5®*^ and by X'^^ when we regard it as an element of B®^. 
In particular, we distinguish between the projective and injective moments 
by writing them as EX®^ e i?®'^ and EX®'' e B®''. They are related by 
the following simple result. 

Theorem 6.2. If the projective k:th moment EX®'^ exists in one of the 
senses above, then the injective k:th moment exists too, in the same sense, 
and is given by 

EX®'= = i(EX®^) e B®^ (6.1) 
in the Bochner or Pettis case and 

EX®'^ = i**(EX®^') e (5®'=)** (6.2) 

in the Dunford case. 

Proof. The identity map on i?®'^ extends to the continuous linear map l : 
J^%)k _^ B®'' . □ 

We next consider the problem of deciding when these moments exist, in 
the different senses. There are six different cases to consider. We shall see 
(Theorem 16.71 and the examples in Section [7]) that the conditions for exis- 
tence differ for five of them, for both measurability and integrability reasons. 
This multiplicity of cases may be bewildering, but in many applications there 
is no problem. If B is separable (or X is a.s. separably valued) there is no 
problem with measurability (Theorem 13. 3p and if further E HXH'^ < oo, then 
both moments exist in the strongest sense (Theorem 16. 7p . and thus in all 
senses. 

We begin by considering conditions for the existence of moments in the 
strongest sense, i.e., as Bochner integrals. 

Lemma 6.3. If X is Bochner measurable in B, then X®'' is Bochner mea- 
surable in S®^, for every k ^ 1. In particular, then a{X, . . . , X) is measur- 
able for any bounded k -linear form a e L(S'^;M). 

Proof. The (non- linear) mapping x ^ x®^ is continuous B B®'^. The 
final claim follows by Theorem 14.61 □ 

Remark 6.4. There is no general corresponding result for weakly mea- 
surable X in the projective tensor product S®^, see Example 17.41 If B is 
separable, or if X is a.s. separably valued, there is no problem since then 
X is Bochner measurable by Theorem 13.31 but weak a.s. separability is 
not enough by Example 17. 4[ Nevertheless, -D[0,1] is an example of a non- 
separable space where X®'^ is weakly measurable in the projective tensor 
product for every weakly measurable X, see Corollary 115.91 

Lemma 6.5. The following are equivalent, for any k ^ 1: 
(i) X®^ is a.s. separably valued in B®'' . 
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(ii) X®^ is a.s. separably valued in B®^ . 

(iii) X is a.s. separably valued in B. 



Proof, (iii) =^ (i) as in the proof of Lemma 16.31 and (i) =^ (ii) since 
i : B®^ — > B®^ is continuous. Hence it remains to prove (ii) =^ (iii) 

Let A be a separable subspace of B®^ such that X®^ e A a.s. Then there 
exists a countable family of elementary tensors F = [en ® • • • ® ejfc} such 
that A is included in the closed linear span of F. Let i?i c _B be the closed 
linear span of {eij}ij. Then Bi is separable, and if x* -L Bi, then x*{eij) = 
for all i and j, and thus x* ® ■ ■ ■ ® x* -L -F; by linearity and continuity, this 
extends to the closed linear span of F, and thus x* ■ ■ ■ x* J. A. 

Hence, if x®^ e A, then (x*,x}'' = ({x*)®'', x®^) = and thus x* 1 x for 
every x* -L which implies that x e Bi. Consequently, X e Bi a.s. □ 

Remark 6.6. Lemma [6. 51 includes a partial converse to Lemma [6.31 consid- 
ering only the a.s. separably valued condition. There is no complete converse 
to Lemma 16.31 since X®^ may be Bochner measurable even if X is not; this 
happens even in the one-dimensional case i? = M, as shown by the trivial ex- 
ample when X is a non- measurable function such that X = +1 everywhere; 
then X®"^ = X'^ = 1 is measurable. We will thus usually assume that X is 
at least weakly measurable. 

It is now easy to characterise when the moments exist as Bochner inte- 
grals. 

Theorem 6.7. Suppose that X is weakly measurable. Then the following 
are equivalent. 

(i) The projective moment E X®'' exists in Bochner sense. 

(ii) The injective moment E X®^ exists in Bochner sense. 

(iii) E < 00 and X is a.s. separably valued. 



Proof. By Theorem 1 5 . 1 1 and Lemma [6. 5 1 (i) and (ii) both imply that X is a.s. 
separably valued: Hence it suffices to consider the case when X is a.s. sepa- 
rably valued, so by Theorem 13.31 X is Bochner measurable. By Lemma [ 



X®'^ is Bochner measurable, and the result follows by Theorem 15.11 since 

\\Y<g)k\\ ^ _ \\y®k\\ ^ _ \\Y\\k |— I 

We turn to Dunford integrals. We first give a simple result on the exis- 
tence of the weak k:th. moment (II. ip . Cf. Remark 15. Ill 

Lemma 6.8. Suppose that X is weakly measurable. Then the following are 
equivalent. 

(i) The weak k:th moment E(x*(X) • • • x^(X)) exists for every 

Xi , . . . , X E JD . 

(ii) E|x*(X)|'^ < 00 for every x* e B* . 

(iii) sup{E|a;*(X)|'= : ^ 1} < oo. 

(iv) Tx : X* ^ x*{X) is a bounded operator B* L'^(P). 
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In this case, K\x*{X) ■ ■ ■ is bounded for x*, 

ofB*. 



, in the unit ball 



Proof. 



If (i) holds, then (ii) follows by choosing x* 



(iii) 



(ii) 



X*. The converse follows by Holder's inequality. 
By definition. 



closed grap^ 



(iv) 



(iv; 



If (ii) holds, then Tx : 



is bounded by the 



1 theorem. The converse is trivial. 



The final claim follows by (iii) and Holder's inequality. 



□ 



In all cases we know, the existence of the weak A;:th moment is equivalent 
to the existence of the injective k:th moment in Dunford sense. We have, 
however, failed to prove this in full generality and suspect that there are 
counterexamples. We thus give a theorem with some technical sufficient 
conditions, and leave it as an open problem whether the theorem holds 
more generally. (This is, at least for bounded X, equivalent to whether X 
weakly measurable implies X®'^ weakly measurable in B'^^; cf. Remark 16.41 
which shows that this does not hold for the projective tensor product.) 

We first state a lemma. 

Lemma 6.9. Suppose that X is weakly measurable and a.s. separably valued. 
Then is jointly measurable on B* x Q, where B* is given the Borel 

a-field for the weak* topology. 

Proof. X is Bochner measurable by Theorem 13. 31 and thus there is a sequence 
Xn of measurable simple random variables in B such that X„ X a.s., see 
Remark 13.21 Then each is jointly measurable on B* x Q, and thus 



{X 



, Xy is jointly measurable. 



□ 



Theorem 6.10. (i) // the injective k:th moment EX®*^ exists in Dunford 
sense, then the weak k:th moment E(x*(X) • • • x|(X)) exists for every 



6 B*, and 



E{xUX) ■ ■ ■ xliX)) = <EX®^ (X) . . . (X) xl). 



(6.3) 



Furthermore, sup{E |x*(X)|' 



^ 1| < 00. 



(ii) Suppose that X is weakly measurable, and that one of the following ad- 
ditional condition holds. 

(a) B is separable. 

(b) X is a.s. separably valued. 

(c) Every integral k-linear form B^ ^ M is nuclear. 

Then the injective moment EX®^ exists in Dunford sense if and only 
if the weak k:th moment exists, i.e., if and only i/E|x*(X)|^ < oo for 
every x* e B* . 



Proof, (i) : Directly from the definition of the Dunford integral, since x* ® 
• • • ® a^fc is a continuous linear functional on B'^^ . The final claim follows by 
Lemma 16.81 
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(ii) : By (i) and Lemma 16.81 it remains to show that if the weak k:th mo- 
ment exists, then x{X'^^) is an integrable random variable, and in particular 
measurable, for every x ^ (-B®'^)*. By Theorem 14.71 x is represented by a 
signed measure /i e M{K^), where K is the closed unit ball of i?*, and 

X{X^')= \ xl{X).-.xl{X)Mxl,...,xl). (6.4) 



obviously is a special case of[(b)| If [(b)] holds, then <x*,X> is jointly 



measurable on B* x Vt hy Lemma 16.91 Hence, x\{X) ■ ■ ■ x^{X) is jointly 
measurable on x 0, and thus we can take expectations in ()6.4|) and 
apply Fubini's theorem, yielding 

^X{X®^)= \ E(xt(X)...x^(X))d/i(xt,...,x|); (6.5) 

note that E|x*(X) • • • 2;^(X)| is bounded on by LemmaEHl so the double 
integral is absolutely convergent. 



If (c) holds, then the integral form x is nuclear and thus, by (j4.12p . 

00 

X=Yi ^nX\n®---®xl^ (6.6) 

71=1 

where ^ 0, Xi^=i < oo and each x*„ e K. Consequently, using (j4.1ip . 

oc 

<X,X®'=>= 2 A„xtJX)...xL(X), (6.7) 

n=l 

which is integrable by Lemma [6.81 Taking expectations in (j6.7p . we see that 
(j6.5p holds in this case too, now for the finite discrete measure 

OC' 

// := 2 (6-8) 

71 = 1 

□ 

Remark 6.11. We do not know any characterization of the Banach spaces 
B such that every integral A;- linear form is nuclear. For k = 2, this can 
be translated to operators B B*; a sufficient condition then is that B* 



has the Radon-Nikodym property and the approximation property, see |57l . 
Theorem 5.34]. 

Corollary 6.12. Suppose that X and Y are weakly measurable B-valued 
random variables, and that one of the following conditions holds: 

(a) B is separable. 

(b) X and Y are a.s. separably valued. 

(c) Every integral k-linear form B^ ^ R is nuclear. 

Then (|1.3p holds if and only EX®^ = Ey®^, with the infective k:th mo- 
ments existing in Dunford sense. (In other words, the injective moment is 
determined by the weak moment.) 
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Proof. If EX®^ = Ey®'^, then the weak moments are equal by (|6.3p . 

Conversely, suppose that the weak moments exist and are equal. By 
Theorem I6.10|. the injective moments EX®'^ and Ey®^ exist in Dunford 
sense. Moreover, the proof of Theorem 16.101 shows that for any x £ (S®'^)*, 
(j6.5p holds for some signed measure /x, which shows that if the weak moments 
are equal, then 

(x, E x®^> = E<x, x®^'> = E<x, y®^> = <x, E y®^> 

for every x and thus EX®'= = EY®^ in (B®'=)**. □ 

Recall that S®^ can be regarded as a subspace of L{{B*)^;M.), the bounded 
/c- linear forms on B*. This leads to the following interpretation of the in- 
jective fc:th moment when it exists in Pettis (or Bochner) sense, and thus 
is an element of B'^^, which again shows that the injective k:th moment is 
essentially the same as the weak moment defined by (jl.ip . 

Theorem 6.13. If X is a B-valued random variable such that the injective 
k:th moment E X'^'^ exists in Pettis sense, thenEX^^ e B®^ is the k-linear 
form on B* 

{xl,...,xl)^E{x\{X)...xl{X)). 

Proof. When EX®^ e B®^ is regarded as a /c-linear form, its value at 
(x*, ... ,xl) ^ {B*)^ equals <EX®*=, a;* (x) • • ■ (x)x^>, and the result follows by 
(US]). □ 

This yields a simpler version of Corollarv l6.12l assuming that the moments 
exist in Pettis sense. 

Corollary 6.14. Suppose that X and Y are B-valued random variables 
such that the injective k:th moments EX®^ and EY®^ exist in Pettis sense. 
Then (II. 3p holds if and only EX®^ = Ey®'^. (In other words, the injective 
moment is determined by the weak moment.) □ 

For the projective A;:th moment in Dunford sense, there is a general similar 
equivalence, now using arbitrary bounded /c-linear forms on B. We have no 
simple necessary and sufficient condition for the existence, but we give a 
sufficient condition which is necessary in at least some cases (Example 17. ip , 
but not in others (Example 17. 3p . 

Theorem 6.15. The following are equivalent. 

(i) The projective moment E X®^ exists in Dunford sense. 

(ii) The moment Ea{X, . . . ,X) exists for every bounded k-linear form 
a:B''^R. 

In this case, 

Ea(X,...,X) =<EX®^a> (6.9) 

for every a e L{B^;M.). 
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Moreover, ifK\\X\\'^ < co and a{X,...,X) is measurable for every a e 
L{B'';R), then\{rj\arid\(uj\hold. 



Proof. The equivalence of (i) and (ii) is an immediate consequence of the 



definition of the Dunford integral and Theorem 14.61 and so is (j6.9p . 

Furthermore, \a{X, . . . , X)\ ^ ||q|| HXH'^'. Hence, if ]E||Xp < oo, then (ii) 



holds provided a{X, . . . , X) is measurable. □ 

Remark 6.16. Although we use multilinear forms a in (|l.'2p and Theo- 
rem [6TT51 we are only interested in the values a{x, . . . ,x) on the diagonal. 
This restriction to the diagonal defines a function a{x) : B ^ M, which is 
a quadratic form for k = 2, a cubic form for A; = 3, etc., and (II. 2p can be 
expressed as ¥.a{X) = Ma^Y) for all such forms a. 

Note also that it suffices to consider symmetric multilinear forms a, since 
we always may replace a by its symmetrization. 

Corollary 6.17. Suppose that X and Y are B-valued random variables. 
Then (jl.2p holds, with finite and well-defined expectations for every a, if 
and only if the projective k:th moments EX®^ and KY'^^ exist in Dunford 
sense and EX®^ = EY^''. 

Proof. An immediate consequence of Theorem 16.151 together with Theo- 
rem HH □ 



The problem whether ()1.2p and (II. 3p are equivalent is thus reduced to 
the problem whether EX®'' = EF®'' implies EX®'= = EF®^, at least if we 
assume that the projective moments exist in Dunford sense, and that one 
of the additional assumptions in Corollarv 16.121 or 16.141 holds. By (j6.2p . it 
then is sufficient that l** is injective. However, in applications we prefer 
not to use the bidual (recall that tensor products typically are not reflexive, 
even if B is reflexive, see Remark 15. 2p : we thus prefer to use moments in 
Pettis or Bochner sense. For these moments, the question whether E X®'' = 
E y(8)fe E = E (for arbitrary X and Y in a given Banach space 

B) is by (16. ip almost equivalent to whether t : B^^ — > B'^^ is injective; this 
will be studied in Section O 

Remark 6.18. We write "almost", because EX®'' is a symmetric tensor, 
so we are really only interested in whether l is injective on the subspace 
of symmetric tensors in iJ®'' (i.e., on the symmetric tensor product). We 
conjecture that l is injective on this subspace if and only it is injective on 
the full tensor product S®'', but as far as we know this question has not 
been investigated and we leave it as an open problem. 

We turn to considering conditions for the existence of moments in Pettis 
sense. We only give a result for the injective moments, corresponding to 
Theorem 16. 101 since we do not know any corresponding result for projective 
moments. 
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Theorem 6.19. (i) // the injective k:th moment EX®*"' exists in Pettis 
sense, then {\x*{X)\^ : x* e B* , \x* \ ^ 1} is uniformly integrable. 

(ii) Suppose that X is weakly measurable, and that one of the following ad- 
ditional condition holds. 

(a) B is separable. 

(b) X is a.s. separably valued. 

(c) Every integral k- linear form B^ -^W is nuclear, and X®*^ is weakly 
a.s. separably valued in B®^ . 

Then the injective moment EX®^ exists in Pettis sense if and only if 
{\x*{X)\^ : X* e B* , ||x*|| ^ 1} is uniformly integrable. 



Proof. ^ By Theorem EZl since <(x*)®^,X®^> = and (j;*)®^ e 



[B®^)* with norm ^ 1 when \\x*\\b* ^ 1- 



(ii): We shall modify the proof of Theorem 16.101 Let x ^ (S®^)* with 
11x11 ^ 1- As in the proof of Theorem 16.101 by Theorem 14.71 there exists a 
signed measure e M{K^), where K is the closed unit ball of such that 
(|6.4p holds; further ||^|| = ||xl| ^ 1. Taking absolute values, and replacing /x 
by we obtain 

\X{X®%^[ \xl{X)---xl{X)\Mxl,...,xl). (6.10) 

or |(b)| holds, then (x*,X'} is jointly measurable on B* x O by 



If (a) 



Lemma 16. 9t thus we can take expectations in (j6.10p and apply Fubini's 
theorem, yielding 

E|x(X®^)|^ f E\xl{X)---xl{X)\dfi[x\,...,xl). (6.11) 



If (c) holds, then the integral form x is nuclear and thus (j6.6p holds, with 



^ 0, Xin=i -^n < 00 and each x*„ e K. We do not know whether the 



nuclear norm of x always equals the integral norm ||x|| when (c) holds, but, 
at least, the open mapping theorem implies that there exists a constant C 
(possibly depending on B) such that we can choose a representation (|6.6p 
with 2n ^ C. Then (j6.7p holds, and taking absolute values and expecta- 
tions we see that ()6.1ip holds in this case too, for the measure ()6.8p . which 
satisfies = Yjn^n ^ C. 

Consequently, in both cases (16. lip holds, with ||/i|| ^ C (where C = 1 in 
cases 



(a) -(b)). By the arithmetic-geometric inequality, ()6.1ip implies 
E|x(X®'=)| ^ £^ E(i g \xt{Xt) d/i(xt, ...,xl) 



k 

^ C7sup{E|3;*(X)|'= : X* e i^}, (6.12) 



If, \ E|x*(X)|^dMxt,...,x^) 



28 



SVANTE JANSON AND STEN KAIJSER 



and applying (I6.12p to Ie^, for an arbitrary event E e J^, we obtain 

EilElxiX®")]) = E\x{1eX®^)\ ^ C sup E{1e\x^X)\^). (6.13) 



x*eK 



This holds for any x £ (5®'^)* with ||x|| ^ 1- Hence, it follows from ()6.12l) - 
(j6.13p and the condition ()5.4p for uniform integrability that if {|x*(X)|^ : 
X* e K} is uniformly integrable, then also {{x^X'^''} : x e (-B®'^)*, ||x|| ^ 1} 
is uniformly integrable. Furthermore, X®'^ is weakly a.s. separably valued. 



by (a) - (b) and Lemma 16.51 or assumption in (c) The result now follows by 



Theorem EJ] apphed to X®^ , □ 

Remark 6.20. Changing the norm in B to an equivalent one will not change 
the tensor products S®'^ and B'^^ (except for a change of norms), and the 
existence (in any of the three senses above) and values of the moments EX®^ 
and EX®'' wih not be affected. 

Remark 6.21. The moments behave as expected under linear transforma- 
tions. If X is a S-valued random variable and T : B ^ Bi is a bounded 
linear map into another Banach space Bi, then TX is a -Bi-valued random 
variable, which is [Borel, weakly, Bochner] measurable if X is. If the mo- 
ment E X®'^ or E X®*^ exists in any of the three senses above, then E(rX)®'^ 
or E(TX)®'^ exists in the same sense; moreover, for moments in Bochner or 
Pettis sense E(rX)®*^ = r®'^(EX®'^), and for moments in Dunford sense 
E(rX)®'= = (T®'=)**(EX®^), and similarly for injective moments. 

Remark 6.22. If X is a -B-valued random variable and -B is a closed sub- 
space of another Banach space Bi, then X can also be seen as a i?i-valued 
random variable. For the injective tensor product, then i?®'^ is a closed 
subspace of Bf'^, see Remark 14.41 and thus by Remark 15.61 the injective 
moment EX®'^ exists in B^^ (or (_B®'=)**) in any of the three senses if and 
only if it exists in B^^ (or (5®*^)**) in the same sense; moreover, then the 
value of the moment in the two spaces coincide. 

For the projective moments, the situation is more complicated since Re- 
mark 14.41 does not hold for the projective tensor product. If we consider 
moments in Bochner sense (and assume that X is weakly measurable), then 
by Theorem EZlEX®^ exists in 5®'^ if and only it exists in Bf'^. However, 
for projective moments in Pettis sense, we can in general only say that if 
the moment EX®'^ exists in S®^, then it exists in Bf'^, and the values are 
the same (by Remark 16.211 applied to the inclusion map) ; we shall see in 
Example 17.31 that the converse does not hold. (And similarly for Dunford 
sense, where we have to consider the biduals.) This shows that when con- 
sidering projective moments of a Banach space valued random variable, we 
may have to be careful to specify which Banach space we are using. 

If -B is a complemented subspace of Bi there is no problem: then there 
is a bounded projection P : Bi ^ B , and it follows from Remark 16.211 that 
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also the projective moments exist for X as a i?- valued random variable if 
and only if they exist for X as a i?i-valued random variable. 

Remark 6.23. We may define moments also in other tensor products (not 
considered in the present paper) in the same way; one example is to take the 
Hilbertian tensor product in Example 14.21 when i? is a Hilbert space. When 
the projective A;:th moment exists, these moments too are given by mapping 
the projective A::th moment EX®'^ e B®^ to the chosen tensor product as 
in ()6.ip or (j6.2p . This is one reason to take the projective A::th moment as 
the standard A;:th moment, when it exists. 

Remark 6.24. It is possible to define mixed moments of random variables 
Xi , . . . , Xk with values in possibly different Banach spaces Bi, . . . , in the 
same way, by taking the expectation of Xi (S) ■ ■ ■ <E) Xk in Bi® • • • §)Bk or 
Bi0- ■ -^Bk- Analoguous results hold, but are left to the reader. In most 
cases, we can consider X = (Xi, . . . , Xk) in the direct sum B := Bi@- ■ -QBk 
and take its moments (provided they exist); they contain the mixed moments 
as components, and we are reduced to the case treated above of moments 
of a single variable. For example, with k = 2, [Bi ©i?2)®^ is the direct sum 
of Bi§)Bi, Bi§)B2, B2®Bi and B2§)B2, and the components of EX®^ in 
these subspaces are EXf^ E(Xi ® Xa), E(X2 ® Xi) and EXf ^ where the 
two mixed moments are the same, using the natural isomorphism Bi0B2 = 
B2§)Bi. 

7. Examples 

We give here some simple (counter)examples to illustrate the results 
above. Further examples, more important for applications, are given later. 

We let be a positive integer-valued random variable, with pn = P(X = 
n), and let U ~ U(0, 1); we may suppose that U is the identity function 
defined on [0, 1] with Lebesgue measure. We use standard notations from 
Section El 

Example 7.1. Let B = H he a separable Hilbert space and let = 2. 

Let a e L{B'^;M) be the inner product in H. Then a(X,X) = <X,X> = 
||Xp. Hence, if the projective moment EX®^ exists in Dunford sense, then, 
by Theorem 16.151 E|[Xp < oo. Furthermore, weak and Bochner measura- 
bility are equivalent by Theorem 13.31 ^iid it follows, using also Lemma 16.31 
that the projective second moment EX®^ exists in Dunford sense if and 
only if it exists in Bochner sense, and consequently if and only if it exists in 
Pettis sense. 

In this case, the projective second moment thus exists in any sense if and 
only if X®^ is measurable and E ||Xp < oo. In particular, the sufficient 
condition in Theorem 16.151 is also necessary in this case. 

Example 7.2. Specialize Example 17.11 to B = i'^ and let X = a^CN for 
some sequence {an)'i ■ We have seen that: 
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(i) The projective second moment EX®^ exists, in any of the three 
senses, if and only if E ||Xp = E |aArp = Yin=i PnO'n < 

The projective tensor product can be seen as the space J\f{£'^) of trace 

class operators on £^ (see Theorem 19. 2p . and EX®^ is the diagonal operator 

The injective tensor product can, similarly, be seen as the space 

]C{1^) of compact operators in l"^ . A diagonal operator Yju^n^n ® e„ has 
norm sup and the subspace of diagonal operators in /C(£^) is isomorphic 
to cq. Since X <^ X = aj^ejy belongs to this subspace, it follows from 
Example 15.141 that 

(ii) EX®^ exists in Dunford sense supp„o^ < cc. 

(iii) EX®^ exists in Pettis sense PnO-n —>■ as n ^ co. 

(iv) EX®^ exists in Bochner sense Hn^iPnO-n < 

EX®^ is, when it exists, the diagonal operator ^PnCin^n^en, just as the pro- 
jective second moment. As usual, in the Dunford case, EX®^ e JC{i'^)** = 
B{£'^) = L(^^;£^). In fact, the diagonal operator ^PnO-nSn0 Sn is compact, 
i.e. EX®^ e /C(^^), if and only if p„a^ ^ as n ^ oo. 

Example 7.3. Let B = ^^[0,1]. Then B§)B = L^{[0,lf), see e.g. (sl. 
Theorem 46.2 and Exercise 46.5]. 

Let X := ajyrN, where is some sequence of real numbers and 

r„ e L^[0, 1] are the Rademacher functions. Then X ® X = aj^rj^ ® t'at- 

By Khintchin's inequality Theorem ILl] (which applies as well to r„® 
r„ e L^([0, 1]^), since these functions too can be seen as a sequence of 
independent symmetric +1 random variables), the L^-norm and L^-norm 
are equivalent on the closed linear span R2 of {r„(x)r„} in L^{[0, 1]^). Since 
X0X e R2, the expectation E(X®X) in B§)B = L^{[0,lf), in any of 
the three senses, can just as well be computed in L^([0, 1]^). However, the 
functions r„ ® r„ form an orthonormal sequence in , and there is thus an 
isomorphism between R2 and given by rn®rn >— >■ e„. Hence it follows 
from Example 15.151 that the projective moment E X®^ exists in Bochner 
sense if and only if E ||Xp = ^PnO-n < while EX®^ exists in Dunford 
or Pettis sense if and only if XiPn'^n < 

For the injective moments, we use Remark l6.22[ X lies in the closed linear 
span i?i of {r„} in L^[0, 1], which by Khintchin's inequality is isomorphic 
to f; thus EX®X may be calculated in Ri<S)Ri = ^^(x)^^. This brings us 
back to Example 17.21 and thus (ii)--(iv) in Example 17.21 hold in the present 
case too. 

Note that if we consider X as an i?i-valued random variable, then Ex- 
ample I7.2l fil shows that the projective moment E X®^ exists in Pettis (or 
Dunford) sense if and only if X!nP""n < Hence, choosing pn and a„ such 
that Pn«n = ^/n, we see that, although Ri is a closed subspace of L^[0, 1], 
E X®^ exists in Pettis (or Dunford) sense if we regard X L^[0, l]-valued 



HIGHER MOMENTS OF BANACH SPACE VALUED RANDOM VARIABLES 31 



random variable, but not if we regard X as an i?i -valued random variable, 
cf. Remark [OS 

Example 7.4. Let B = and let X := a{U)eu where a : [0,1] 

(0, 1] is some given function. Then {X, /) = a.s. for any / e ^^[0, 1], since 
/ has countable support, and thus X is weakly measurable and weakly a.s. 
separably valued. Trivially, EX = in Pettis sense. However, a subspace 
A such that X e A a.s. has to contain et for a.e. t e [0, 1], and is thus not 
separable. Consequently, X is not a.s. separably valued, and therefore not 
Bochner integrable. 

Furthermore, every integral bilinear form on a Hilbert space is nuclear 
(Theorem EH below), and thus by Theorem [63(]rii][c)[ EX®^ 

exists in 



Dunford sense; by ^3^, EX®^ = o. (By Theorem [921 EX®^ = o also in 
Pettis sense.) 

Let a e L{B'^;M.) be the inner product in B = i'^[0, 1]. Then a(X,X) = 
(X, X) = ||Xp = a{U)'^. If we assume that a is a non-measurable func- 
tion (for Lebesgue measure on [0, 1]), then a(U) is non-measurable. Hence, 
a(X, X) is non-measurable, and by Theorem 16.151 the projective moment 
EX®^ does not exist in Dunford sense (and thus not in the other, stronger, 
senses). 

In particular, we see that although X is weakly measurable in B, X®X 
is not weakly measurable in B^B, since {a, X ® X) = a(X, X) is not 
measurable. (We use here Theorem 14.61 ) 

Furthermore, X (x)X is not weakly a.s. separably valued in B0B, by the 
following argument. Suppose that A is a separable subspace of B0B. Then, 
as in the proof of Lemma 16.51 there exists a countable family of elementary 
tensors F = {eii0 ei2} such that A is included in the closed linear span of 
F. Let R := (Ji, 

• supp(ejj); then R c [0, 1] is countable and if y ^ A, then 

supp(y) ^RxR. Define ^ e if§>fr by /3(/,5) := S^^r /(t)ff(t). Then 
Pien, ei2) = for ah i, and thus /3 1 F and /3 1 A, but /3(X, X) = <X, X> = 
a{Uf 7^ a.s. 

Example 7.5. Let, as in Example 15.141 B = cq and X = aMSN- Thus 
X®'= = a%ef. 

Let 1= Cq'^ be the subspace of finite linear combinations of tensors 
e®'^; we claim that the closure of is the same in both the projective and 

injective tensor products c®'^ and Cq"^ and that it equals A^ := (XiJ^Li ^n^?^ • 
(6„)^ e Co}. (For the injective tensor product, this follows immediately from 
Theorem I12.H but the projective case is less obvious.) Since Ay^. obviously 
is isomorphic to cq, it then follows from Example 15.141 that: 

(i) EX®'^ exists in Dunford sense EX®'^ exists in Dunford sense 
^^^supp„a^ < 00. 

(ii) E X®'^ exists in Pettis sense E X®'^ exists in Pettis sense 
PnO-n ^ as n ^ 00. 
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(iii) EX®^ exists in Bochner sense EX®'^ exists in Bochner sense 

Hence there is no difference between projective and injective moments in 
this example. (Cf. Example 17.21 where we see that A2 is the closure of 
also in but not in 

To verify the claim, consider for simplicity first k = 2, and let u = 
bnGn ® Cn e Recalling (14.3P and (I4.6p . and taking x* = xl = en in 
the latter, we have immediately 

ll'^lk ^ H'wlle ^ max (7.1) 

n 

For C = (Ci, • • • , Cm) with = +1, take := Xi^i Cn&nCn e cq and : = 
Xlnii CnCn ^ Cq. Then, See and (077]), 

ll^'C ® ■"^cll'f = 11 ''^C II CO II II CO =max|6„|. (7.2) 

Taking the average of ® over the 2^'^ possible choices of C, we obtain 
u, and thus 

||n||^ ^ max (7.3) 

n 

Consequently, we have equalities in (|7.ip . for any u e A°, which shows that 
the closure in either co®co or co®co is isomorphic to cq and equals A2. 

The argument extends to arbitrary /c ^ 2 by letting the possible values of 
Cn be the A;:th roots of unity and considering (These vectors are 

complex, but we can separate them into real and imaginary parts, possibly 
introducing a constant factor 2^ in the norm estimate (|7.3p .) 

Example 7.6. We say that a random variable X in a Banach space B is 
weakly Gaussian if x*{X) is Gaussian with mean (for convenience) for 
any x* e B* . To exclude cases such as Example 17.41 where x*{X) = a.s. 
(and thus is Gaussian) but X does not look very Gaussian, we say that X 
is Gaussian if it is weakly Gaussian and a.s. separably valued. (By Theo- 
rem [3131 this is equivalent to weakly Gaussian and Bochner measurable.) 

If X is (weakly) Gaussian, then x*{X) is Gaussian and thus has finite 
moments of all orders, for any x* e B*. Thus Theorem I6.1[pi][b) shows 
that every injective moment EX®'^ exists in Dunford sense. 



Moreover, if X is Gaussian, by [4^, Lemma 3.1 and Corollary 3.2] (applied 
to a suitable separable subspace Bi B with X e Bi a.s.), 11X||^ < oo 
for every k. Hence, Theorem 16.71 shows that the projective and injective 
moments ¥.X®^ and EX®^ exist in Bochner sense for every k ^ 1. 

The odd moments vanish by symmetry. 

The even injective moments can be expressed in terms of the second mo- 
ment S := EX®^ as follows. Consider first k = 4. Then, by Theorem 16.131 
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and Wick's theorem [13, Theorem 1.28], EX®^ e B^'^ is determined by 

<X®^ ® (X) x| (X) x|> = K{xl {X)x^ {X)xl {X)) 

= E(xt(X)x2*(X)) E(x3*(X)x|(X)) + E(xt(X)x3*(X)) E(x*(X)x|(X)) 

+ E{xUX)xl{X)) E(x2*(X)x3*(X)) 
= <S, (X) x^><S, x| (X) x|> + <S, x^ (X) x|><S, x^ (x) x|> 

+ <S,xt(x)x|><S,x^(x)x|>. 

This can be written as 

E X®^ = S (X) S + 7r(23) (S (X) S) + 7r(24) (S (x) S) , (7.4) 

where tTo- denotes permuting the coordinates by the premutation a. There 
are 24 permutations of {1, 2, 3, 4}, but 8 of these leave S ® S invariant, and 
we may write (I7.4p more symmetrically as EX®^ = 3 Symm(E (x) S) , where 
Symm means the symmetrization of the tensor by taking the average over 
all permutations of the coordinates. 

More generally, for any even k = 2i, by the same argument, 

E X®2^ = ^ Symm ((E X®^)®^) e B^^', (7.5) 

which generalizes the standard formula E^^^ = (Var ^)^ for a real- valued 
centred Gaussian variable ^. 

We conjecture that the corresponding formula for projective moments 
holds too. If B has the approximation property, this follows by (17. Sp and 
Theorem 18.31 below, but we leave the general case as an open problem. 

8. The approximation property 

Let Bi,B2 be Banach spaces. Recall that a finite rank operator F : 
Bi ^ i?2 is a continuous linear operator whose range has finite dimension; 
equivalently, it is a linear operator that can be written as a finite sum 
F{x) = Xir=i ^ii^)yi for some x* e B* and e i?2- 

We say that a linear operator T : Si — > i?2 is uniformly approximable by 
finite rank operators if for every e > there exists a finite rank operator 
F : Bi ^ B2 such that ||T — F|| < e. Similarly, we say that a linear 
operator T : Bi —>■ B2 is approximable on compacts by finite rank operators 
if for every compact set K <^ Bi and every £ > there exists a finite rank 
operator F : Bi ^ B2 such that sup{||Tx — Fx\\ : x e K} < e. 

If i? is a Banach space, then the following properties are equivalent; see 
e.g. [H, Section l.e] and [HI, Chapter 4] for proofs. The Banach space B is 
said to have the approximation property when these properties hold. 

(i) The identity operator I : B ^ B is approximable on compacts by 
finite rank operators. 

(ii) For every Banach space Bi, every bounded operator T : B ^ Bi is 
approximable on compacts by finite rank operators. 
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(iii) For every Banach space Bi, every bounded operator T : i?i — > i? is 
approximable on compacts by finite rank operators. 

(iv) For every Banach space Bi, every compact operator T : Bi —> B is 
uniformly approximable by finite rank operators. 

(v) For every pair of sequences Xn ^ B and x* e i?*, n ^ 1, such that 

ll^nll ll^^nll < * 2]^=i ^n(^)^n = for all X e B , we have 

(vi) For every pair of sequences Xn ^ B and x* e i?*, n ^ 1, such that 

Yin=i ll^nllll^nll < ^^'^ Xin=i = X e B , we have 

I]^=ix„(x)x* = in B§)B*. 

(vii) For every Banach space Bi and every pair of sequences Xn ^ B and 
yn e Bi,n^ 1, such that II ^"11 II 2/™ || < « and ^* i^n)yn = 
for all X* e B* , we have Xi^J^i ^n® Vn = ^ hi B®Bi. 



Remark 8.1. The property dual to (iv) , viz. that every compact operator 
T : B ^ Bi is uniformly approximable by finite rank operators, for every 
Banach space Bi, is not equivalent to the other properties; in fact, it is 
equivalent to the approximation property of B* . 

Moreover, it is known that if B* has the approximation property, then 
B has the approximation property, but the converse does not hold. (See 
Example 18.51 for a concrete example. There are also counterexamples that 
are separable with a separable dual (43|.) 



We can reformulate conditions (vi) and (vii) as follows, recalling the 



canonical injection l in (j4.8p . (This is implicit in the references above, and 
explicit in e.g. f6l|.) 

Theorem 8.2. Let B be a Banach space. If B has the approximation prop- 
erty, then the canonical mapping l : B0Bi B®Bi is injective for every 
Banach space Bi. 

Conversely, if the canonical mapping l : B0B* B®B* is injective, 
then B has the approximation property. 

Proof. Let u e B®Bi; then u = ® Vn for some Xn ^ B and yn e Bi 

with Xi^=i lls^nll l|yn|| < 00- We can regard B®Bi as space of bilinear forms 
on B* X B*, and then, for any x* e B* and y* e Bf 



X {Xri)yf 



L{u){x*,y*) = 2 X*{Xn)y*{yn) = 2/* ( XI 
71=1 rj=l 

Hence, i{u) = if and only if Yin=i x*i^n)yn = for every x* e B*. 

Consequently, (vii) says precisely that, for any Si, if -u e B^Bi and 
i{u) = 0, then u = 0, i.e. that l : B§)Bi B^B\ is injective. 

Furthermore, (vi) is the special case Bi = B*, and thus says that l : 
B§)B* B®B*- is injective. □ 

This can be extended to tensor products of several spaces. We state only 
the case of tensor powers of a single space, which is the case we need. 
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Theorem 8.3. If a Banach space B has the approximation property, then 
the canonical mapping l : B®^ B^^ is injective. 

Proof. We use induction in k. The case A; = 1 is trivial, and /c = 2 is a 
consequence of Theorem 18. 2[ For k ^ 3 we write i : B®^ as the 

composition 

= B§)B^'-''-^^ ^ = 

where the first map is injective by Theorem 18.21 and the second is injective 
by induction and Lemma 14.31 □ 

Remark 8.4. The approximation property for B is not equivalent to 



B®B — > B®B being injective. In fact, a counterexample by Pisier [521 . 
Theorem 10.6] shows that there exists an infinite-dimensional Banach space 
B such that B^B = B^B (with equivalent norms); moreover, this space B 
lacks the approximation property. 

The study of the approximation property was initiated by Grothendieck 
3^, 3^ who found most of the results above but did not know whether any 



Banach spaces without the approximation property exist. The first coun- 
terexample was found by Enfio [2^, who constructed a separable, refiexive 
Banach space B without the approximation property. A modification of the 



counterexample given by Davie [15|, [la] , see also Lindenstrauss and Tzafriri 
[i^ . Theorem 2.d.6], shows that B may be taken as a subspace of cq or of 
for any 2 < p < cc. Another counterexample was found by Szankowski 



6ll |. who showed that the space B{H) of bounded operators in an infinite- 
dimensional Hilbert space does not have the approximation property. 

On the other hand, it is easy to see that any Banach space with a 
(Schauder) basis has the approximation property; this includes all classi- 
cal examples of separable Banach spaces. (In fact, Enflo's counterexample 
[2^ was also the first known separable Banach space without a basis.) There 
are also many non-separable Banach spaces with the approximation prop- 
erty. The list of Banach spaces with the approximation property includes, 
for example, {1 ^ p ^ 00), cq, L^ifJ-) (1 ^ p ^ go, any measure), C{K) 
{K a compact set). 

Example 8.5. The tensor products and have bases and thus 

have the approximation property, see e.g. [H^, Proposition 4.25 and Exercise 
4.5]. As said in Example 14.21 see also Theorem 19.21 these spaces can be 
identified with the spaces of trace class operators (= nuclear operators) and 
compact operators in respectively; moreover, £^(x)£^ = (£^(x)£^)*. How- 
ever, (£^®£^)* can be identified with the space B{i'^) of bounded operators 



in which as just said does not have the approximation property [61]. 

We can now prove Theorems 11.11 and 11.21 

Proof of Theorem \l.l\ By Theorem 16.71 the projective and injective mo- 
ments EX®^, Ey®'', EX®"^, Ey®'^ exist in Bochner sense. If holds. 
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then EX^'' = EY^'' by Corollary EH By this can be written 

t(EX®'^) = l{'EY'^^), and since Theorem 18.31 shows that t is injective, we 
have EX®*= = KY^''. By Corollary ElTl this yields (fOj) . 

The converse is trivial. □ 

Remark 8.6. More generally, Theorem 18.31 implies that for any Banach 
space B with the approximation property, if E X®^ and E Y®^ (and thus 
also EX®'' and EY^'') exist in Pettis sense and EX®'^ = EY^'', then 
EX®*"' = Ey®*^. We do not know whether this remains valid if we only 
assume that the moments exist in Dunford sense. (Theorem 111.231 is a 
positive result in a special case.) 

Proof of Theorem \1.2l Let Bq be a Banach space without the approximation 
property and let B := Bq^Bq, with the norm \\(x,x*)\\b '■= max(||x||, ||x*||). 
By choosing Bq to be separable and reflexive, we obtain B separable and 
reflexive too. We shall show that there exist bounded Bochner measurable 
random variables X and y in i? such that, for k = 2, (II. 3p holds but not 



Since Bq does not have the approximation property, by (v) above, there 

00 



exist sequences x„ e Bq and x* e Bq with such that Xin=i II ^"11 ll^nll < * ^^'^ 
Tin^i Kix)xn = for ah xe B, but x*{xn) = 0. Let a„ := ||xn|| 

so < < 00. We may eliminate all (x„,x*) with = 0, and 

we may thus assume that a„ > for each n. Define y„ := x„/||x„|| e Bq, 
y* := 11 e Bq and pn '■= an/ Yim^i ^m- Thus y„ and y* are unit vectors 

and Yin^iPn = 1- Furthermore, the properties of x„ and x* translate to 

00 



Pny*n{z)yn = for every z e Bq, (8.1) 
n=l 

00 

2 Pnyliyn) ^ 0. (8.2) 

n=l 

Let be a random positive integer with the distribution ¥(N = n) = Pn, 
and let X and Y be the i?-valued random variables 

X := (2/Ar,y^), 

:= {yN,-yN)- 

Note that ||X|| = ||y|| = 1 a.s. Then, if a is any bounded bilinear form 
B X B ^R, then 

q(X,X) =a((2/^,0), (2/^,0)) +Q((yjv,0),(0,y^)) +a((0,y^), (2/^,0)) 

+ a((0,y^),(0,y^)) 

and similarly for Y. Hence, 

Ea{X,X) -Ea{Y,Y) =2Ea{{yN,0),{0,y%)) +2Ea{{0,y%),{yN,0)). 

(8.3) 
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In particular, letting a be the bounded bilinear form a((x, x*), (y, y*)) := 
x*{y), we have by (18.20 

oc 

Ea{X,X)-Ea{Y,Y) = 2Ey^(yjv) = 2 ^ Pny*iyn) ^ 0. 

Hence, (jl.2p does not hold. 

On the other hand, if x*,x^ e B*, then x*{x,x*) = z*{x) + z**{x*) for 
some z* e Bq and z** e Sq*, i = 1,2. Hence, 

E{xUyN,o)xmyN)) = E{zUyN)zriyN)) = zr{HzUyN)yti))- (8-4) 

However, the continuous linear functional 

00 

y* := E{zl{yN)yN) = ^ Pnzt{yn)yl e B^ 

n=l 

satisfies, for every x e Bq, 

OC' 00 

y*{x) = Yj Pnzt{yn)yl{x) = ztl^Yi Pnyl{x)yn) = 

ri=l n=l 

by dSl]). Thus y* = and ([831) yields 

Interchanging and Xg, we see that also E(x*(0, y^)x2(yAr, 0)) = 0. Thus 
(j8.3p with a{xi,X2) ■= x*(xi)x|(x2) yields 

E{xt{x)xux)) -E(xt(y)x2*(y)) =0, 

which shows that ()1.3p holds. □ 

The counterexample in this proof has also other unpleasant consequences. 

Example 8.7. Let the separable Banach space B and the random variables 
X and Y be as in the proof of Theorem II. 2[ By Corollaries 16.171 and 16.141 
E{X§)X) ^ E{Y§)Y) in 5®2 but E{X®X) = E{Y0Y) in B®^, where ah 
moments exist (in Bochner sense) by Theorem 16.71 

We can embed as a closed subspace of a Banach space Bi with the 
approximation property, for example by the Banach-Mazur theorem which 
says that every separable Banach space can be embedded as a closed sub- 
space of C[0, 1]. Let i : B ^ Bi denote the embedding. 

We may regard X and Y also as i?i-valued random variables. Then the 
injective second moment E(X(g)X) in B^B is mapped by to the injec- 
tive second moment E(X(x)X) in Bi0Bi, and it follows that E{X0X) = 
E(Y^Y) also in Bi^Bi, i.e., X and Y have the same injective second mo- 
ments in Bi. 

It follows from Theorem l8.3l (as in the proof of Theorem I 1 . 1 p that E(X^X) = 
E(Y0Y) in Bi^Bi, i.e., X and Y have the same projective second moments 
in Bi although they have different projective second moments in B(S)B. This 
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shows that if a Banach space valued random variable takes values in a sub- 
space of the Banach space, we may have to be careful with in which space we 
calculate the projective moments. (Note that Lemma 14.31 and Remark 14.41 
show that there is no such problem for injective moments.) 

Since maps the second projective moments in B^B to the second pro- 
jective moments in Bi^Bi, we have shown that E(X(g)X) = K{Y0V), 
although E{X§)X) E(y®y). Consequently, i%i : B®B Bi§)Bi is not 
injective, see Remark 14. 5[ 

Remark 8.8. A simplified version of the counterexample in Example 18.71 
without mentioning moments, is the following: let i? be a subspace of a 
Banach space Bi such that Bi has the approximation property but B has 
not. Let i : B ^ Bi he the inclusion. 

Then i : B§)B* B®B* is not injective by Theorem Thus the 
composition : B§)B* B®B* Bi®B* is not injective, but this 

equals the composition : B§)B* Bi®B* ~> Bi®B* . On the other 

hand, since Bi has the approximation property; i : Bi^B* Bi0B* is 
injective by Theorem 18. 2( hence i®/ : B^B* — > Bi0B* is not injective. 



9. HiLBERT SPACES 

Consider the case B = H, a Hilbert space. We shall give some special 
results for second moments. (We do not know whether the results extend to 
moments of order k ^ 3 or not, and leave this as open problems.) We begin 
with some well-known results. 

Theorem 9.1. A Hilbert space has the approximation property. 



Proof. Property (i) in Section [8] is easily verified using suitable orthogonal 



projections. □ 

Next, we note that H* = H; hence the correspondence (|4.9p yields an 
isometric embedding of H^H into B{H) = L{H; H), the space of bounded 
linear operators on H. We identify a tensor in H^H and the corresponding 
operator without further comment; hence we regard H^H as a subspace of 
B{H). Moreover, an elementary tensor x y corresponds to an operator 
of rank 1, and every operator of rank 1 is given by an elementary tensor; 
hence the tensors in H <S) H, which are finite sums of elementary tensors, 
are exactly the operators on B of finite rank. The injective tensor product 
H®H is thus the closure in B{H) of the set of finite rank operators, which 



shows (see (iv) in Section [8j) that H^H = JC{H), the space of compact 
operators H ^ H. 

The natural map H^H M{H, H) onto the nuclear forms is a bijection; 
moreover, the nuclear and integral bilinear forms on H coincide. Equiva- 
lently, the integral and nuclear operators H ^ H coincide, and furthermore, 
the set of them equals the set of trace class operators, which we denote by 
AA(iif). We can thus identify all these spaces of bilinear forms or operators 



HIGHER MOMENTS OF BANACH SPACE VALUED RANDOM VARIABLES 39 



with H0H. (See e.g. [H, Chapter 48 and Proposition 49.6]. See further 
e.g. Exercise IX.2.20] or O Chapter 31].) 

With these identifications, the map l : H0H H^H is just the inclu- 
sion map J\f{H) 1C{H) ^ B{H). (By Theorem and H* = H, the 
approximation property is equivalent to the fact that l : H®H H®H is 
injective, which we thus also see explicitly.) 

We summarize these descriptions of the tensor products. 

Theorem 9.2. Under the identification (j4.9p of tensors and operators H* = 
H ^ H , we have H0H = J\f{H), the space of trace class operators on H 
(which equals the space of nuclear operators), and H^H = JC{H), the space 
of compact operators. □ 

Theorem 9.3. Every integral bilinear form on H is nuclear. The space of 
these forms can he identified with H^H . □ 

The general formulas (Si^^a)* = L(5i, S2; M) and {Bi®B2Y = ^{Bi, B2), 
see Theorems 14.6111771 can be translated to operators as M{H)* = B{H) 
and IC{H)* = J\f{H), where the dualities are given by the trace form 
<r, 5> = Tr{TS*). 

In particular, {H0H)** = 1C{H)** = B{H). Thus, if the second injective 
moment exists in Bochner or Pettis sense, it is by the correspondence (j4.9p 
given by a compact operator in IC{H), and if it exists in Dunford sense it 
is, again by (|4.9p . given by an operator in B{H). Similarly, if the second 
projective moment exists in Bochner or Pettis sense, it is given by a trace 
class operator in J\f{H), and the second injective moment equals the same 
operator. In all these cases, the following theorem shows that the second 
moment is a positive operator. (In particular, it is self- adjoint.) 

Theorem 9.4. If the second moment EX®^ exists in Bochner or Pettis 
sense, or EX®2 exists in any sense, then, regarding the moment as an 
operator in B{H), it is a positive operator. 

Proof. In all cases, it follows that the injective moment EX®^ exists in 
Dunford sense. Thus, for x e H,hy (j6.3p . 

<EX®\,x> = <EX®^a;(x)3;> = E<X,x>2 ^0. □ 

Remark 9.5. The only case remaining is the second projective moment 
EX®^ in Dunford sense, which belongs to M{H)** = B{H)* . We shall see 
in Example 19.151 (under a set theory hypothesis) that this moment is not 
always given by an operator on H. 

However, if H is separable, or more generally if X is a.s. separably valued, 
and EX®^ exists in Dunford sense, then it exists in Pettis sense too and 
thus EX®2 e M{H). This follows from Theoremj5T3l since M{H) does 
not contain a subspace isomorphic to cq (e.g. by Theorem V.IO], since 
H§)H is a separable dual space when H is separable; we omit the details); 
moreover, we shall prove a more general result by a different method in 
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Theorem 19. 141 which shows that in essentiahy all cases (again depending on 
a set theory hypothesis), the Dunford and Pettis senses coincide and thus 

We next characterize when the injective second moment exists, in the 
three different senses; we begin with two lemmas. 

Lemma 9.6. Every weakly measurable H-valued random variable is weakly 
a.s. separably valued. 

Example 17.41 shows that X is not necessarily a.s. separably valued. 

Proof. Let {e^lsGS be an ON basis in the Hilbert space H, and let '■= 
|(es,X)p. Since X is weakly measurable, each is a non-negative random 
variable. 

Let C be the collection of countable subsets A<^ S. For Ae C, let 
U-=J]^s = J]\(es,X}\^^\\Xf<a:^ 

seA seA 

Thus every is a finite non-negative random variable, and Ai <^ A2 =^ 
(.Ai ^ (,A2 ■ 

Let mA_ '■= Earctan^/i, and 

:= sup{myi : A e C}. (9-1) 

Note that m* ^ 7r/2 < 00. 

There exist An e C with mA„ > — 1/n, so taking A^ := (J^^^ A^ we 
have m^^ ^ rn^ and thus the sup in (|9.ip is attained. Moreover, for any 
s ^ A^, A^ u {s} e C and thus rnA^^{s] ^rn^ = ruA^, i.e., 

Earctan^^^^jjs} ^ Earctan^^^. (9-2) 

Since ^a^^{s} = + 6 ^ ^A*, (1121) implies arctan(^A* + 6) = arctan^A* 
a.s., and since ^yi^ < co, thus = a.s. Consequently, if s ^ A:^, then 

(es,X} = a.s. (9.3) 

Let M be the closed linear span of {e^ : s e ^*}. M is a separable 
subspace of H. If y e M-*-, then y = Xis^A* ^s^s with only a countable 
number of 7^ 0; hence (j9.3p implies (y, X} = a.s. □ 

Lemma 9.7. If X is a weakly measurable H-valued random variable, then 
X®^ is weakly a.s. separably valued in H®'^ . 

Proof. By Lemma 19.61 there exists a separable subspace M <^ H such that 
x*(X) = a.s. for every x* _L M. Let M be the closed subspace of H^H 
spanned by {x (x) y : x, y e M}. 

Let a e then a is a bilinear form on H which by Theorem 19.31 

is nuclear; thus there exist x*,y* with 2^=1 l^nlllynll < s-i^d 

00 

a(a^>y) = 2 ^n{x)yl{y)- (9.4) 

n=l 
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Assume that a _L M. 

Let P : H ^ M he the orthogonal projection onto M and Q := I — P. 
Decompose a as app + apq + aqp + cxqq, where app{x,y) := a{Px, Py), 
apQ{x,y) := a{Px,Qy), aQp{x,y) := a{Qx,Py), aQQ{x,y) := a{Qx,Qy). 

For any x,y e H, a{Px,Py) = {a, Px0 Py} = 0, since x®y e M. Hence 
app = 0. Consider one of the other terms, for example apq. By (19. 4|] . 

00 00 

apQ{x,x) = Y,{<,PX){yl,QX) = Y,(P<,xXQy:,x}. (9.5) 

n=l n=l 

However, Qy* _L M and thus, by the choice of M, (Qy*,X} = a.s., for 
every n. Hence (j9.5p yields apQ{X, X) = a.s. 

Similarly, apQ{X, X) = a.s. and apQ{X, X) = a.s., and thus 

(a, X (X) X> = a{X, X) = apQ{X, X) + aQp{X, X) + aQQ{X, X) = a.s. 

This holds for every a _L M, and thus X X is weakly a.s. separably 
valued. □ 

Theorem 9.8. Suppose that H is a Hilbert space and that X is a weakly 
measurable H-valued random variable. 

(i) The injective second moment EX®^ exists in Dunford sense if and 
only if E \{y, X)p < go for every y e H. 

(ii) The injective second moment E X®^ exists in Pettis sense if and only if 
the random variables \{y,X}\'^, for y e H with \y\ ^ 1, are uniformly 
integrable. 

(iii) The injective second moment EX®^ exists in Bochner sense if and 
only if X is a.s. separably valued and E ||Xp < oo. 



Proof, (i) : By Theorem 16. IC l^ii)|[c) , using Theorem 

(ii) By Theorem 19.31 Lemma 19.71 and Theorem 16. 1£ t^ii][c^ 



(iii) : A special case of Theorem 16.71 □ 



In the Hilbert space case, the different types of integrability can also be 
characterized by the value of the moment. 

Theorem 9.9. Suppose that H is a Hilbert space and that X is a weakly 
measurable H-valued random variable such that the injective second moment 
EX®^ exists in Dunford sense. Regard EX®^ as a bounded operator in 
B{H). 

(i) The injective second moment exists in Pettis sense if and only if E X®^ e 
1C{H). 

(ii) The injective second moment exists in Bochner sense if and only if X 
is a.s. separably valued and EX®^ eJ\f{H). 



Proof, (i) : If the moments exist in Pettis sense, then E X®^ e H®H 
IC{H). 
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Conversely, suppose that EX®^ e )C{H). Let E be any event. Then 
E{lEXf^ + E{lEcXf^ = E(l£;X®2) + E(lscX®2) = EX®2. 

Since E{1eX)^^ ^ and E{1ecX)^^ ^ (in operator sense) by Theo- 
rem [931 it follows that 



^ E(l£;X®2) ^ EX®^ (9.6) 

It is easily verified that if S,T e B{H) with ^ S" ^ T and T compact, 
then S too is compact. (For example because S^/'^ = VT^^"^ for some V e 
B{H), and thus S = S^I'^{S^I^Y = VTV* .) Hence, ([SSD implies that 
E(1bX®2) e IC{H) = H®H for every event E, which means that X®^ 
satisfies the definition of Pettis integrability. 



(ii) : If E exists in Bochner sense, then E X®^ too exists in Bochner 
sense by Theorem [63 Hence, EX®^ = EX®^ e H®H = M{H). Moreover, 
X is a.s. separably valued by Theorem 16.71 

Conversely, suppose that EX®^ e M{H) and X is a.s. separably valued. 
Let M be separable subspace of H such that X e M a.s. and let {en}n be a 
(countable) ON basis in M. Then ||Xp = Yjui^i^nf a.s., and thus 

nxf = Y^KX^enf = Y,{EX®^en,en) = Tr(EX®2) 

n n 

^ ||EX®2||^(^) <a). 
Thus E X®^ exists in Bochner sense by Theorem 16.71 □ 

Theorem 9.10. Suppose that H is a Hilbert space and that X is a weakly 
measurable H -valued random variable such that the injective second moment 
EX®^ exists in Dunford sense. Regard EX®^ as a bounded operator in 
B{H). If EX®^ e M{H) and X is a.s. separably valued, then the projective 
second moment E X®^ exists in Bochner sense. 

Proof. By Theorem 19.^(ii)| and Theorem 16.71 □ 

Remark 9.11. If the projective second moment exists in Bochner or Pettis 
sense, it is an element of H®H = J\f{H). The second injective moment is 
the same, and is then thus a trace class operator. 

Theorem 19.101 gives a converse when X is a.s. separably valued. However, 
the converse does not hold in general; a weakly measurable random variable 
in a non-separable Hilbert space can have an injective moment in Pettis 
sense that is a trace class operator, even if the projective second moment 
does not exist; see Example 17.41 

For the projective second moment, all three senses coincide for //-valued 
random variables, provided d\m{H) is not too large. 

Definition 9.12. A cardinal m is real-measurable if there exists a set S 
with cardinality jSI = m and a probability measure defined on the u-field 
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2"^ of all subsets of S that is diffuse, i.e., such that fi{s} = for every s e S. 
(Obviously, then such a measure fi exists for every set S with IS*! = m.) 

A cardinal m is measurable if there exists such a measure that takes only 
the values and 1. 

Remark 9.13. If measurable cardinals exist, they have to be very large; 
larger than the first strongly inaccessible cardinal. It is consistent with the 
standard ZFC axioms for set theory to assume that there are no strongly 
inaccessible cardinals, and thus no measurable cardinals. Whether it also 
is consistent to assume the existence of measurable cardinals is not known. 
See [iO, Chapter IX.3-4] and fsO]. 

Real-measurable cardinals may be smaller. There exists a real-measurable 
cardinal that is non-measurable c is real-measurable Lebesgue 



measure on [0, 1] can be extended to all subsets of [0, 1], see [GJ] and [62 
Section 16.2]. 

If the Continuum Hypothesis holds, then c is not real-measurable, see [3] 
and [s^], and thus every real- measurable cardinal is measurable and thus 
extremely large. Consequently, it is consistent to assume that there are no 
real-measurable cardinals at all. In this case, the following theorem applies 
to all Hilbert spaces without qualification. (The separable case was given in 
Example 17.11 ) 

Theorem 9.14. Let H be a Hilbert space such that dim if is a non-real- 
measurable cardinal. If X is an H -valued random variable, then the following 
are equivalent. 

(i) EX®^ exists in Dunford sense. 

(ii) EX®^ exists in Pettis sense. 

(iii) EX®^ exists in Bochner sense. 

(iv) X is a.s. separably valued, X®^ is weakly measurable in iJ®^ and 



EIIXP < 00. 



Proof. 



m 



(i) 



Theorem 15. H using Lemma 



is trivial and (iv) =^ (iii) for any space by 



6.51 and Theorem 13. 31 It remains to show that 



(iv) 



Suppose that EX®^ exists in Dunford sense and let z := EX®^. By 
definition, X®^ is weakly measurable in iif®^. 

Let M be a closed subspace of H and let Pm : H ^ M he the orthogonal 
projection. Then aM^x^y) := {Pmx, Pmu} is a bounded bilinear form on 
H; om can by Theorem 14.61 be regarded as a continuous linear functional 
on H®H and 

<aM , z) = E<aAf , X (X) X> = E OM (^, ^) = E II PmX \\ ^ . 
Hence, ||P/v/Xp is measurable and its expectation is finite. Define 

:= ^WPuXf < cc. 
In particular, E ||Xp = fin < oo- 
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If Ml c M2, then ||Pa/^X|| ^ ||Pjv/2-'^ll and thus ^ fJ'Ah- In particular, 
fJ-M ^ fJ'H for every closed subspace M <^ H , so {fiM ■ M <^ H] is bounded. 

Furthermore, if Mi 1 M2, then UPmiSMs-'^P = II^'mi-'^P + \\Pm2X\? and 
thus 

^^^h®M2 = f^Mi + ^J'M2■ (9-7) 
Let Z be the set of separable closed subspaces of H, and let 

/X* := sup{/iM : M e Z}. (9.8) 

Thus ^* ^ /U/f < 00. There exist M„ e Z such that ;Um„ > — 
n ^ 1. Let M* be the closed linear hull of M^. Then M^, is separable so 
Mh= e Z, and M„ ^ M,^ so //m* ^ A*Af„ > — l/?^- Consequently, /^m* = A** 
and the supremum in (|9.8p is attained. 
By (I92D, 

/^H = + fJ'M^ = + /^A./±- (9.9) 

Assume first /i* = /ijy. Then (|9.9p yields 

and thus = a.s.; hence X e M,^ a.s. so X is a.s. separably valued. 

It remains to show that if fj,,^. < fin, then dimff is real-measurable, which 
contradicts our assumption. In this case, choose an ON basis {egjseS in 
M^. For each subset A S, let Ma be the closed subspace of H spanned 
by {es}seA and let fJ.{A) := = ^ \\Pma-^V- Then // is finitely additive by 
(10) . Moreover, if An / A, then \Pma^^\ / II^Af^^ll and thus /x(A„) / 
[li^A) by monotone convergence. Consequently, // is a cr-additive measure 
defined on (5,2"^). For any s e 5", Mj^j = Me^ is one-dimensional and thus 
© Mj^} is separable, so 

+ ^M{,} = ^Af* + /^Af{,} = /^Af*©Af{,} ^ 

Hence, := /^Aff^} = 0, which shows that the measure /i is diffuse. On 
the other hand, M5 = M^ and thus by ([9:9]) 

/i(5) = /iAfs = /^AfJ- = ptH - ^* > 0. 

Consequently, by normalizing /i we obtain a diffuse probability measure on 
(S", 2'^), which shows that \S\ is a real-measurable cardinal. Since dim(i?) ^ 
l^l, dim(ff) is real-measurable too. (In fact, dim if = IS"! + dimM* = 
|5| + Ho = |5|.) □ 

The assumption in Theorem 19.141 that dim H is not real-measurable is 
necessary as is seen by the following example. (Cf. the related Example 17. 4[ ) 
Nevertheless, Theorem 19.141 shows that the projective second moments for 
practical applications only can be used for Bochner measurable random 
variables, i.e., in the a.s. separably valued case. 

Example 9.15. Suppose that dimii is a real-measurable cardinal. Let [i 
be a diffuse probability measure on (5, 2'^) for some set S with IS*! = dim//. 
Since then K ^ i'^{S), we may assume that H = i'^{S). 
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Define X : (5,2^,/i) H = f{S) by X{s) = e,. Then X is bounded, 
and since every function on {S, 2^ , /j) is measurable, X is weakly measurable 
in H and X (S) X is weakly measurable in H(S>H. Hence EX®'^ exists in 
Dunford sense. {X and X X are also Borel measurable, for the same 
reason.) Furthermore, if a is the bilinear form on H given by the inner 
product, <EX®2,a> = Ea{X,X) =E\\Xf = 1 and thus EX®^ ^ 0. 

On the other hand, the argument in Example 17.41 shows that X is not 
a.s. separably valued. (In fact, if M is any separable subspace of H, then 
X J- M a.s.) By Theorem 16.71 EX®-^ does not exist in Bochner sense. 

Note further that <x*,X) = a.s., for every x* e H* = H. Thus the 
injective second moment EX®"^ exists in Dunford (and Pettis) sense by 
Theorem [931 and ([631) shows that EX®^ = o. However, using Dunford 
senses, EX®"^ ^ 0, as shown above, and EX®^ = i**(EX®2) by (fOj) . 
Since i : H®"^ H®"^ is injective, this shows that EX®^ ^ H®"^; hence 
EX®^ does not exist in Pettis sense. 

Example 9.16. Consider Gaussian random variables in a Hilbert space H. 
As shown in Example 17. 6|, if X is Gaussian, then EX®'^ and EX®*^ exist 
in Bochner sense. In particular, EX®^ = EX®^ is an element of H0H = 
M{H), i.e., a trace class operator. By Theorem [Ol EX®^ = EX®^ is a 
positive trace class operator. 

Conversely, if S is any positive trace class operator in a Hilbert space H, 
then there exists by the spectral theorem for compact self-adjoint operators. 



see e.g. [l3|. Corollary II. 5. 4], an ON set {en)n=i iii H such that 

00 

S = 2 A„e„®e„, (9.10) 



n=l 



where A„ ^ and = \\^\\j\f{H) < Let {^n)n=i be i.i.d. standard 

normal variables and define X := Xi^^i -^^^"^^nGn', it is easily seen that this 
sum converges a.s., that X is Gaussian, and that EX®^ = Xin'=i ^n^n®^n = 
S. 

Consequently, the second moment of a Gaussian random variable in a 
Hilbert space is a positive trace class operator, and can be any such operator. 
Moreover, the second moment determines the higher moments by (17. Sh . and 
thus the distribution by Theorem 117.31 below. 



10. LP{^) 

Let 1 ^ p < 00 and let B = LP{^) = L^{S,S,ij,), where /i is a fi-finite 
measure on a measurable space {S,S). Note first that L^ifJ-) has the approx- 
imation property, see e.g. j57|. Example 4.5]. (It suffices to consider the case 
when /i is a probability measure, and then (i) in Section [8] is satisfied by 
using conditional expectations on suitable finite sub-cr-fields; we omit the 



46 SVANTE JANSON AND STEN KAIJSER 

details.) Furthermore, LP{S,S, fi)* = L'^(S, S, u), where q e (1,go] is the 



conjugate exponent given by p-^ + g-i = 1 [22, Corollary IV.8.1,5]. 

If X : {s,uj) ^ X{s,u;) e M is an (5 x J^) -measurable function on S x Q, 
then X{s) = X[s, •) is a (real-valued) random variable for every s; moreover, 
for each to e Cl, X{-,uj) is a function on 5, and if further \X{s, cj)|^ d^(s) < 
CO a.s., then X can be regarded as a mapping {Q,T,F) — > L'^ifi), i.e., as a 
random variable in i? = L^(/x). This random variable is Bochner measurable, 
as stated in the following lemma; see [2^, III. 11. 16-17]. 

Lemma 10.1. IfX : {s,uj) X(s,u}) eM is an {S x -measurable function 
on S X Q and ^g\X{s,u})\P d^{s) < oo a.s., then X can be regarded as a 
Bochner measurable mapping (i7, J^, P) L^(/i), i.e., a Bochner measurable 
{fi) -valued random variable; conversely, every Bochner measurable U'{^)- 
valued random variable is (a.s.) represented in this way by some (/i x P)-a.e. 
unique (5 x J^) -measurable X on S x i}. □ 

Theorem 10.2. Let 1 ^ p < ao, let q be the conjugate exponent given by 
p^^ + q^^ = 1, and let {S,S,fi) be a a-finite measure space. 

(i) Suppose that X : S x 0, ^ M is {S x J^) -measurable and that : = 

^g\X[s,uj)\^ dfj,[s) < 00 a.s. Regard X as an {fj,) -valued random 
variable and suppose further that E||X||^p^^^ < go. Then, EX®^ e 

U'{S,^)®^ and EX®^ e U\S,ij)^^ exist in Bochner sense. Further- 
more, E X®^ and E X®^ are represented by the a. e. finite function 

$fc(si,...,Sfc) ■.= ¥.{X{.si,uj)---X{sk,uj)) (10.1) 

in the sense that if gi, . . . , gk e L'^il^) = (-^^ (/"))*; then 

<EX®^5l (X) . . . (x)5fc> = <EX®^ 51 ® • • • (x)5fc> 

^>fc(si, . . . , Sk)gi{si) ■ ■ ■ gk{sk) d/i(si) • • • d/i(sfc). (10.2) 



is'' 

(ii) Let Y be another L^{^)-valued random variable represented by an {S x 

k 



T) -measurable function Y : S x 0. —>■ M. such that E ||^|||pc„\ < oo, and 



let 

^k{si,...,Sk) ■.= E{Y{si,u)---Y{sk,u;)). (10.3) 

Then the following are equivalent 

(a) EX®^ = Ey®^• 

(b) EX^'' = EY^''; 

(c) For any gi,...,gk e Li{F), 

E «9i ,X}---(gk,X}) = E «5i ,Y}---(gk, Y}) ; 

(d) = a.e. on S'' . 
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Proof, (i) : X is Bochner measurable by Lemma 110.11 and thus E and 
E X'^^ exist in Bochner sense by Lemma 16.31 and Theorem 15.11 (or by Theo- 



rem [621) • Furthermore, by (16.30 and Fubini's theorem, using Lemma llO.l^ 

<EX®^ 51 (X) . . . ® 5fc> = E{(gi,X} ■ ■ ■ (gk, X}) 

= E X{si) ■ ■ ■ X{sk) giisi) ■ ■ ■ gk{sk)dfi{si) ■ ■ ■ d^(sfc) 

E[X{si) ■ ■ ■ X{sk))giisi) ■ ■ ■ gk{sk) d/x(si) • • • d/i(sfc). 



f 



showing (jl0.2p . 



(ii) : The moments exist in Bochner sense by (i) , Then 
Theorem [53] and ([6T|) , [(b)] <^ [(c)] by Corollary [6Ti] and 



(b) 



(b) 



(d) 



by 
by 
□ 



Example 10.3. In the special case p = 2, -L^(//) is a Hilbert space, and we 
can also apply the results of Section [3 (Since X is Bochner measurable by 
Lemma [10.1^ and thus a.s. separably valued, it suffices to consider a sepa- 
rable subspace of L^(/x).) In particular. Theorem 19.81 and Theorem 19.91 give 
conditions for the existence of the injective second moment in the different 
senses, while Theorem 19.141 shows that for the second projective moment, 
the different senses coincide. 

Example 10.4. Another interesting special case isp = 1. We have L^{S, /x)®^ 

(when it exists 



53, Exercise 2.8]; thus EX®^ e L^{S^,^i'') 



Li(5'=,/), see 

in Bochner or Pettis sense); clearly EX®*^ equals the function <I*fc in (110. ip 
when Theorem 110.21 applies. 

Example [73] shows that EX®'= may exist in Pettis sense in L^{S,fi)®'^ = 
L^{S^,H^) without existing in Bochner sense. In this case EX®*^ is still 
given by a function <I>fc in L^{S^,fi^) but the pointwise formula (jlO.ip may 
fail; in Example 17.31 we have X{s,u}) = +0^ for all s and uj, and thus 
\X{si,uj)X{s2,u^)\ = aj^, so the expectation in (jlO.ip exists (for any 81,82) 
only when Ea^ = XjnP"^n ^ which in this case is the condition for 
E X®^ to exist in Bochner sense, see Example l7.3t we may choose Pn^n = 1/^ 
to obtain our counterexample. In this example, EX®^ equals Xin^'^^n'^" ® 
r„, where the sum converges in L'^, and thus in L^; the sum also converges 
pointwise a.e. (since it is a sum of independent random variables defined on 
[0,1]^), but (when PnC^n = 1/"-) say) does not converge absolutely at any 
point. 

We do not know any necessary and sufficient conditions for the existence of 
EX®*^ in Pettis sense in L^{S, n)®^ = L^{S^,^^), nor for the existence of in- 
jective moments beyond Theorem 16. 101 where (ii)||^b) applies by Lemma fl 0.11 
(Even for = 1, the existence of the mean EX in Pettis sense in L^{p) 
seems difficult to characterize exactly, since it is essentially equivalent to 
X e L^(/i)(x)L^(P), which has no simple description, see Remark 15.201 ) 
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Since L^{S^,ii^) does not contain any subspace isomorphic to cq (e.g. as 
a consequence of [571 , Theorem 6.31 and Corohary 6.21]), it follows from 
Theorem 15.131 that if X is Bochner measurable (e.g. by Lemma llO.ip . then 
EX®^ exists in Pettis sense as soon as it exists in Dunford sense. 

Example 10.5. Taking 5" = N with counting measure, we obtain i^, 1 ^ 
p < CD. (See e.g. Examples [SJSl EH and [721 ) In this case, X = {Xn)n=i 
and $fc is by ([10. ip the function E(X„^ • • ■ Xn^^ on N'^. Consequently, by 
Theorem if E||X||fp < c» and E||y||^p < oo, then EX®'^ = EF®^ if 

and only if all mixed /c:th moments of {Xn)n=i and {Yn)n=i coincide. 

Note that moments may exist in Pettis sense also under weaker assump- 
tions, see Example 15. 15[ 

Note that the projective tensor product dP^ff' with 2 < p < cc and the 
injective tensor product (P^dP with 1 < p <2 are reflexive, see [57i, Corollary 
4.24]. In these cases, at least, the second moment thus exists in Pettis sense 
as soon as it exists in Dunford sense. 

11. C{K) 

In this section we study the case B = C{K) where i^' is a compact space. 
(By compact we mean compact Hausdorff.) The perhaps most important 
example is C[0, 1]. 

Note that several other Banach spaces are isomorphic to C{K) for some 
compact K. Hence the results in this section apply to these spaces too. 

Example 11.1. Let C\^{Z) be the space of bounded continuous functions 
on a completely regular topological space Z. Then C\^{Z) = C{(3Z), where 
/3Z is the Stone-Cech compactification of Z, see e.g. [27, Section 3.6], (sol . 
Chapter 6] and [l^ . Section V.6 and Exercise VIII. 2. 7]. Note that Z is a 
dense subspace of (3Z, and that every bounded continuous function on Z 
has a unique continuous extension to /3Z. 
One important example is 

= Cb(N) = C(/3N). (11.1) 

Example 11.2. We shall see in Theorem [US that £'[0,1] = C(/) for a 
compact space /. 

Example 11.3. If B is any complex commutative C*-algebra, then B = 
C(c(S), the space of complex- valued continuous functions on the maximal 
ideal space S, see [13, Section VIII. 2], and thus the subset B^ '■= {f ■ f = 
/*} of hermitean (i.e., real) elements is isomorphic to C(S). This includes 
Examples [ILTH1L21 

Example 11.4. Let L be a locally compact space and L* = L u {oo} its 
one-point compactification. Then Co{L) = {/ e C{L*) : /(oo) = 0} is a 
subspace of codimension 1 in C(L*). Hence, if X is a random variable in 
Co{L), we can regard it as a random variable in C{L*). Note that Co{L) is a 
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complemented subspace. (Every subspace of finite codimension in a Banach 
space is complemented.) 

In particular, cq = Co(N) is a (complemented) subspace of codimension 
1 in c = C(N*) = C(N u {go}). (In fact, cq is also isomorphic to c, by the 
mapping (o„)^ (a^+i + ai)i°, but it seems more convenient to use the 
inclusion.) 

We begin by noting some well-known facts. See e.g. [stI . Example 4.2], 



571 . Section 3.2] and Theorem V.6.6], respectively, for proofs. 



Theorem 11.5. C{K) has the approximation property, for any compact 
K. □ 

Theorem 11.6. If Ki, . . . , are compact spaces, then C(i^i)(x) • • • ^C{Kk) 
= C{Ki X • • • X Kk) (isometrically) with the natural identification. In par- 
ticular, C{K)'^^ = C{K^). □ 

Theorem 11.7. C{K) is separable if and only if K is metrizahle. □ 

Corollary 11.8. If K is a compact space, then C{K)^^ can be regarded as 
a subspace of C{K)®^ = C{K^). (As a vector space; typically, the norms 
differ.) 

Proof. By Theorem [lL5] and Theorem [Ol l : C{K)®^ C{K)^^ is injec- 
tive. Furthermore, C{K)®^ = C{K^) by Theorem [UJl □ 

Remark 11.9. Except in trivial cases {k = \ oi K finite), C{K)®^ is not a 
closed subspace of C{K)®^ , and thus the norms are different and not even 
equivalent on C{K)®^. This is implicitly shown for cq by Littlewood [44], 
who showed (in our terminology) the existence of a bounded bilinear form 
a e (cf^)* which does not belong to (cf^)* = co(N2)* = ^^(N^); the result 
can be transfered to C{K) for any infinite compact K. (See also the proof 
of Theorem 116.21 for an argument from [gH] for C[0, 1].) 

Theorem 11.10. Let X be a C{K)-valued random variable, where K is a 
compact space. If EX®^ exists in Bochner or Pettis sense, then it is the 
function in C{K)'®^ = C{K'^) given by 

EX®^(ti,...,tfc) =E(X(ti)---X(tfe)). (11.2) 

Proof. EX®'' e C{K)®^ = C{K^) by Theorem[lL6l Furthermore, the point 
evaluations 5t, t e K, are continuous linear functionals on C{K), and thus 

KX^^ti, ...,tk)= <EX®^ (X) . . . ® 5t,} = E{X{ti) ■ ■ ■ X{tk)) . (11.3) 

□ 

Note that the function (lll.2p is the standard k:th moment function for 
a stochastic process; in particular, for /c = 2 and EX = 0, EX®^ is the 
covariance function. 
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Example 11.11. Let W be standard Brownian motion in C[0, 1], see Exam- 
ple l5.121 Then aU (projective and injective) moments exist in Bochner sense, 
e.g. by Theorem II 1.251 below. Ah odd moments vanish by symmetry. E VF®^ 
is the covariance function E(VF(s)VF(t)) = Cov {W{s),W{t)) = SAt regarded 
as a continuous function in C([0, 1]^), and EH^®^ is the same function re- 
garded as an element of the subspace C[0, 1]®^. Similarly, EW^®"^ = EVF®*^ 
is the function in C([0, 1]^) given by, see e.g. [stI ]. 

E{Wih)Wit2)W{t3)WiU)) 

= ih A t2){t3 A ti) + {h A h){t2 A U) + {h A h){t2 A tg). (11.4) 

Remark 11.12. If EX®'^ exists in Dunford sense, then pi.2p still defines 
a bounded function on K^, but the function is not necessarily continuous 
(Example I11.28P : moreover, this function by itself does not in general de- 
termine EX®'^ e C{K^)** uniquely, not even for k = 1, and not even if 
it happens to be continuous. (Note that the point evaluations do not form 
a total set in C{K^)*.) Indeed, in Example 111.301 we shall see a K and a 
random variable Z e C{K) such that EZ exists in Dunford sense (but not 
Pettis sense) with EZ ^ 0, but E(Z(t)) = for every t e K. (This cannot 
happen when K is metric, see Corollary I11.17| see further Remarks 111.181 
and lll.2^ ) We therefore prefer the Pettis or Bochner case for applications. 

Apart from the previously defined u-fields on C (K) , we let C be the cr- field 
generated by the point evaluations / ^ f{t), t e K. Thus X : ^ ^ C{K) 
is C-measurable if and only if X(t) is measurable for every t e K. Since 
St € C{K)*, it is immediate that every weakly measurable random variable 
X is C-measurable; we shall see that the converse holds when K is metrizable 
but not in general (Example lll.3ip . 

Further, let B{K) be the Borel cj-field on K. 

We also let M{K) be the space of signed Borel measures on K, and A4 
be the cr-field on M{K) generated by the maps n ^ {f^j f} '■= Si^/d/^j 
/ e C{K). Note that every // e M{K) defines a continuous linear functional 
on C{K), so there is a bounded linear map M(K) C{K)*. Moreover, 
by the Riesz representation theorem (see e.g. [22 . Theorem IV. 6. 3], [l^ . 
Theorem 7.3.5], [l^, Theorem III. 5. 7]), this map is an isometric bijection 
of the subspace M^^K) of regular measures onto C{K)*. (In many cases 
Mr(K) = M{K), for example when X is a metrizable compact space, see 
0, Proposition 8.1.10].) 

Theorem 111.71 implies that if ii' is a compact metric space, there are 
no measurability problems; some results are given in the following lemma. 
However, if K is not metrizable, and thus C{K) is not separable, the situ- 
ation is more complicated; we have to be more careful with measurability 
in statements, but even so, many results below do not hold for arbitrary 
compact K, see the (counter)examples at the end of the section. We thus 
state most of our results for the metrizable case only. (See Sections [l2] and 
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[T5VI161 together with Examples 111.41 and 111.21 for examples of non-separable 
spaces C{K) where most results hold, although some new arguments are 
required.) 

Remark 11.13. All spaces C{K) where K is an uncountable compact met- 
ric space are isomorphic as Banach spaces [46*], [H^ (although not isometri- 
cally); hence they are all the same as C[0, 1] from an abstract point of view. 
We shall, however, not use this; we prefer to regard the spaces concretely. 

Lemma 11.14. Let K he a metrizahle compact space. 

(i) The mapping {f,t) f{t) is jointly {C x B{K)) -measurable on C{K) x 
K. 

(ii) The mapping (/, n) f is jointly {C x Ai) -measurable on C{K) x 
M{K). 

In particular, (/, x*) (a;*,/) is jointly (C x A4) -measurable on 
C{K) X M,{K) = C{K) X C{KY. 

Proof. Choose a metric d on K. For each n ^ 1 there is a finite covering 
of K by open sets Uni, 1 ^ i ^ Nn, of diameters < 1/n. We may find a 
partition of unity subordinate to {f/„i}i, i.e., a set of functions fni e C{K) 
such that fni > 0, J^^ fni = 1 and {t e K : > 0} e Uni- (For example, 

let gni{t) := d{t,U^^ and fni := gni/J^j9nj-) 

Choose some tni e Uni. For any function / e C{K), 

f{t)-J]f{tm)fni{t)\ = SVip\Y,{f{t)-f{tm))fni{t) 

i * i 

^ sup V \f{t) - f{tm)\fm{t) ^ sup{|/(t) - /(^.)| : |t - n| < 1/n} 
* i 

-0 (11-5) 
as n — > CO. Xhis shows first that /(t) = lim^— >oo ^i f (tni) fniit) , which is 



sup 

t 



C X 0(i^)-measurable, showing (i^ 

Moreover, (jll.5p imphes that, for all / e C{K) and fi e M{K), 

/d/i= lim Y\f{tni) fnidfj,, 
where the right hand side evidently is (C x A^)-measurable 



This proves the first claim in (ii) , and the final claim follows by the Riesz 



representation theorem discussed before the lemma. □ 

Corollary 11.15. If K is a metrizahle compact, then C coincides with the 
a-field Bw on C{K) generated hy the continuous linear functionals, and also 
with the Borel a-field B. Hence, if X : Q ^ C{K), then X is Bochner 
measurable X is weakly measurable X is C-measurable. 

Proof. By Lemma fl 1.141 each / ^ (x* , /) with x* e C{K)* is C-measurable. 
Conversely, each point evaluation f{t) = {St, f} where 6t e C{K)*. This 
proves that C and B^ coincide. 
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Furthermore, = S in any separable Banach space, see Section [3l so 
Theorem 111.71 completes the proof. □ 

If K is not metrizable, i.e., when C{K) is not separable, we cannot ex- 
pect equivalence with Bochner measurability. Moreover, Examples 111.311 
and 1 11. 32] show that then in general C; hence we cannot expect equiv- 

alence between weak measurability and C-measurability. Moreover, Exam- 
ple 111.311 constructs a random variable that is C-measurable but not weakly 
measurable. (Recall that we only consider complete probability spaces.) 
Nevertheless, we shall see in Theorems 112.41 and 115.51 (using Examples 111.41 
and 111.2]) that there exist important cases of non-separable C{K) such that 
Bw = C and thus the last equivalence holds. 

We can now complete the proof of Theorem 11.31 in the introduction. 

Proof of Theorem \1.SX By Theorems 111.71 and 111.51 C {K) is separable and 
has the approximation property. Hence, Theorem 11.11 applies and shows (to- 
gether with its proof, or Corollary EH]) that ([O]) <^ EX®^ = 
E y®'^ , where the moments exist in Bochner sense by Theorem 16.71 Finally, 
EX®'^ = Ey®'^ dll]) by (fTL2]) . □ 

We continue with further results and next give a complete characterization 
of the existence of injective moments in the different senses in the metrizable 
case. 

Theorem 11.16. Let K he a metrizable compact space and suppose that X 
is a C-measurable C{K) -valued random variable. Let k ^ I. 

(i) EX®'^ exists in Dunford sense the weak k:th moment exists 

suptg^E|X(t)|'' < 00. 

(ii) EX®'^ exists in Pettis sense the family {|X(t)|^ : t e K} of 
random variables is uniformly integrable. 

(iii) EX®'^ exists in Bochner sense E(sup(g;^ |X(t)|)^ < co. 

Proof. By Corollarv 111.151 X is weakly measurable. 

(i) Since C{K) is separable by Theorem 1 11. 71 Theorem 16. lCl^ii)|[a) shows 



that EX®'^ exists in Dunford sense if and only if the weak fc:th moment 
exists. Moreover, in this case E|x*(X)|^ ^ C for some C < oo and all 
X* e C{K)* with ^ 1. In particular, taking x* = 6t, E |X(i)|'= ^ C. 

Conversely, if E|X(t)|'= ^ C for all i e K, and /x e C{K)* c M{K) 
with ||/x|| = 1, then, by Holder's inequality and Fubini's theorem (using 
Lemma ET^I)]), 

k 

f X(t)dMt) ^eT \XittdMt)= f E|X(t)|'=d|A.|(t) 

JK JK JK 

^ C. (11-6) 



EK/i,X>|'= = E 



Hence Lemma 16.81 shows that the weak A::th moment exists. 
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Since C{K)^^ = C{K^), its dual space is C{K^Y = M,{K^) c 
M{K^). If /i e M{K^) with ||/x|| ^ 1 and E is any event, then by the 
arithmetic-geometric inequality and Fubini (using Lemma ll 1.1^ 

E{lE\(^^,X®''}\) =e(ie 



j^^X{ti)---X{tk)dfi{tu...,tk) ^ 

^ E (^1e £^ li\X{ht + ■■■ + \X{tkt) d|/i|(ti, . . . , tfc)) 
k 

= l\ J]E{lE\Xit,t)dMh,... 



tk) 



^ snpE{l E\X{tt). (11.7) 

teK 



It follows from (fTTTl) . using (I53D, that if {|X(t)|^ : t e K} is uniformly 
integrable, then so is the family {{/i, X®*^) : \\fi\\ ^ 1}. Since C{K) 



(x)A: 



IS 



separable when C{K) is, it follows by Theorem 15.81 that the moment EX®^ 
exists in Pettis sense. 

Conversely, if EX®^ exists in Pettis sense, then {\X{t)\'' : t e K} is 
uniformly integrable by Theorem 16. lS((i)| taking x* = 6t, t e K. 



(iii) Immediate by Theorem 16.71 since C{K) is separable. □ 



Already the case k = 1 m. Theorem 1 1 1 . 1 6 1 is non-trivial and gives the fol- 
lowing characterisations of the existence of the expectation EX of a C{K)- 
valued random variable. 

Corollary 11.17. Let K he a metrizable compact space and suppose that 
X is a C -measurable C{K) -valued random variable. 

(i) EX exists in Dunford sense sup^g^ E |X(t)| < oo. 

(ii) EX exists in Pettis sense the family {X[t) : t e K} of random 
variables is uniformly integrable. 

(iii) EX exists in Bochner sense E(sup^g^ |X(t)|) < oo. 

In the Pettis and Bochner cases, EX is the continuous function t »— > E(X(t)). 
Also when EX exists just in Dunford sense, it is given by this function 
(bounded by not necessarily continuous) in the sense that for any fi e C{K)* = 
M{K), 

<^,EX>= f E(X(t))d/i(t). (11.8) 
Jk 

Proof. It remains only to verify (Ill.Sp . If X is Pettis or Bochner integrable, 
()11.8p follows by Theorem 111.101 In the more general Dunford case we have 
by Fubini, using Lemma 111. 14( 

</i,EX> = E<^,X> = E f X(t,w)d^(t)= f E(X(t,w))d^(t). (11.9) 

Jk jk 

□ 
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Remark 11.18. For non-metrizable K, (Ill.Sp is not true in general for 
Dunford integrable X, as seen in Example lll.30j cf. Remark 111.121 (The 
reason that the proof above fails in this case must be that we cannot use 
Fubini in (jll.9p . because X{t,ijj) is not jointly measurable.) 

We know that if the moment exists in Pettis sense, it is given by the 
function (jll.2p which then has to be continuous. The next theorem shows 
that in the separable case (i.e., when K is metrizable compact), it is for 
the existence of an even injective moment in Pettis sense also sufficient that 
this function exists and is continuous. This is not true for odd moments, 
not even the first moment EX, as is seen in Example 111.261 b elow : nor does 
this hold in general for non-metric K as is seen in Example 111.301 

Theorem 11.19. Let K be a metrizable compact space and suppose that X 
is a C -measurable C{K) -valued random variable such that sup^g^ E |X(t)p < 
00. Suppose that k ^ 2 is even. Then the following are equivalent. 

(i) EX®^ exists in Pettis sense. 

(ii) (ti, . . . , tfc) t— > E(X(ti) • • • X(t,fc)) is continuous on K'^ . 

(iii) t ^~>KX{t)'' is continuous on K. 



In this case, EX®^ is the function in C{K^) given in (ii) 



Proof, (i 



(ii) =^ (iii) 



m, 



(ii) By Theorem lll.lOl which also shows the final statement. 
Trivial. 

(ij If t„ ^ t in K, then X(t„) X{t) and thus X{tnf ^ X{tf . 
Furthermore, by (iii), and the fact that k is even, E|X(t„)|'^ ¥.\X{t)\^. 



Hence {|X(t„)|H is uniformly integrable and thus \X{tn)\^ l-'^(*)l'^ in 
L-^(P), see e.g. [3J, Theorem 5.5.2]. Consequently, the map t >— > |X(t)|'^ is 
continuous K —>■ L^(P), and since K is compact, {|X(t)|'^ : t e K} is a com- 
pact subset of L^(P), and in particular weakly compact and thus uniformly 



integrable [22l . Theorem IV. 8. 11]. Thus (i) follows by Theorem I ll.lq(ii)| □ 



We turn to projective moments. For the second moment, we can show 
that the conditions for the injective moment in Theorem 111.161 also imply 
the existence of the projective second moment. This uses the following result 
by Grothendieck [34] see e.g. [s^ . Theorem 5.5] or 0, Theorem V.2]. (These 
references also contain further related results. In particular, Grothendieck's 
theorem is essentially equivalent to Grothendieck's inequality, see [53.1431].) 

Let kc denote Grothendieck's constant. (It is known that 7r/2 ^ kc ^ 
7r/(21og(l -I- \/2)), but for us the value is not important. ) 

Theorem 11.20 (Grothendieck). If K is a compact set and a is a bounded 
bilinear form on C{K), then there exists a Borel probability measure on 
K such that 

\a{f,g)\ ^'ikG\\a\\\\f\\L2^K,fi)\\9\\L^{K,i,)- (11.10) 

Hence, a extends to a bounded bilinear form on L'^{K,fj,) of norm ^ 2A;G!||a||. 

□ 
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Remark 11.21. The standard formulation is for a bilinear form a on 
C[Ki) X C[K2) for two compact sets Ki and ^"2; then there exist prob- 
ability measures and ^2 on Ki and K2 such that 

^ ^G||a||||/||L2(/^i,^i)||9llL2(i^2,/i2)- (H-H) 

We are only interested in the special case Ki = K2, and we may then 
replace fii and uy. by jj, := ^(//i + //2) to obtain (jll.lOp . (An inspection of 
the proof in e.g. [S^] or 0] shows that we may take kc in the version (jll.lOp 
too provided a is symmetric, but this is not enough in general; consider for 
example a{f,g) := f{0)g{l) on C[0, 1]. Recall that we only have to consider 
symmetric a for our purposes, cf. Remark 16. 161 ) 

This leads to the following improvement of Theorem 111.161 when k = 2. 
This does not extend to /c ^ 3 by Example 111.271 

Theorem 11.22. Let K be a metrizable compact space and suppose that X 
is a C -measurable C{K) -valued random variable. 

(i) EX®^ exists in Dunford sense EX®^ exists in Dunford sense 

the weak second moment exists sup^gj-^- E < 00. 

(ii) EX®^ exists in Pettis sense EX®^ exists in Pettis sense 

the family {|X(t)p : t e K} of random variables is uniformly integrable. 

(iii) EX®^ exists in Bochner sense EX®^ exists in Bochner sense 
^ E(sup,,^|X(t)|)'<oo. 

Proof. The forward implications are immediate, using Theorems 16.21 16.101 
16. 19|, [6771 and Lemma [6.8| see the proof of Theorem 111.161 It remains to show 
the converses. Note that X{t,uj) is jointly measurable by Lemma lll.141 

Suppose that E|X(t)p ^ C for every t e K. Let a be a bounded 



bilinear form on C{K). By Theorem [TL2Q1 a extends to a bounded bilinear 
form on L?'{K,p) for some probability measure on K. Since C{K) Q 
L'^{K,fi), we can regard X as an (K , fi)-valued random variable. Since 
X{t,uj) is jointly measurable, it follows, see Lemma llO.ll that X is Bochner 
measurable in L?'{K,^). Moreover, by Pubini, 

EllXll^a^^^ = E J |X(t,w)pd^(t) = J E|X(t)pd^(t) ^ C < 00. (11.12) 

Hence, Theorem 16.71 shows that EX®^ e L?{K,^)®'^ exists (in Bochner 
sense). In particular, since a extends to L'^{K,fi), a(X, X) is measurable 
by Lemma 16.31 and 

E a(X, X) = E<a, X®^) = (a, E X®^) 

exists. Since a is an arbitrary bounded bilinear form on C{K), Theorem l6.151 
now shows that E X®^ exists in Dunford sense in C(i^)®^ too. 



(ii) Assume that the family {|X(t)| : t e K} is uniformly integrable. Let 



a be a bounded bilinear form on C{K) with ||q|| ^ 1 and let as above /U be 
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as in Theorem 111.201 E e is any measurable set, then by (Ill.lOp and 
Fubini, 

E • a{X, X)\ ^ E(lE2kG \X{t, oj)\'^ d/i(t)) 

= 2kG f E{lE\Xit,u;)\^) dfiit) ^ 2kGSupE{lE\X{t)\^) 
JK teK 

It fohows, using ([53]), that the family {a{X, X) : a e L{C{K)^;R), \\a\\ ^ l} 
is uniformly integrable. Moreover, X®'^ is trivially weakly a.s. separably 
valued since C(i^)®^ is separable. Hence Theorem 15.81 shows, using Theo- 
rem 1321 that EX®-^ exists in Pettis sense. 

This is (again) a special case of Theorem 16. 7|, included here for 



completeness. □ 

As an immediate corollary, we can weaken the integrability condition in 
TheoremOin the case A: = 2 to -.teK} and {\Y{t)\^ : t e K} being 

uniformly integrable, since it is enough for the proofs above of Theorems ll.il 
and O that the moments EX®^ and Ey®^ 

exist in Pettis sense. By the 
methods in the proof of Theorem lll.l9l we can weaken the condition further; 
the following theorem shows that in this case, it suffices that the moments 
exist in Dunford sense. 

Theorem 11.23. Let K be a metrizable compact space and suppose that 
X and Y are two C -measurable C{K) -valued random variables such that 
supjg;^ < 00 and sup^g;^ < Then, for k = 2, the following 

are equivalent. 

(i) (II. 2p . i.e., Ea(X,X) = E.a(Y,Y) for every bounded bilinear form a 
on C{K). 

(ii) i.e.,E[xl{X)xl{X)) = E[xl{Y)xl{Y)) , for any xl,xl e C{KY . 

(iii) (m, i.e., E{X{ti)X{t2)) = E{Y{ti)Y{t2)) for any ti,t2 e K. 

(iv) EX®^ = Ey®^ in C{K)®'^, with the moments existing in Dunford 
sense. 

(v) EX®^ = Ey®^ in C{K)'^^, with the moments existing in Dunford 
sense. 



show that (iii 



(iii) 




(i) 





Proof. The implications (i) =^ (ii) =^ (iii) are trivial, and the equivalences 



(i) (iv) and (ii) (v) are Corollaries 16.171 and I6.1^(a)[ It remains to 



Thus, let a e L{C{Kf;R) = (C(i^)®2)* As in the proof of Theo- 
rem 111.221 there exists by Theorem 111.201 a probability measure on K 
such that a extends to L'^{K, //) and EX®^ exists in L'^{K, //)®^ in Bochner 
sense; similarly E y®^ exists in L'^{K,^)®'^ in Bochner sense. 
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As a consequence, the injective moments E and E y®^ exist in (K, fj,)®'^ 
in Bochner sense. Let g,he L'^{K,fi)* = L?{K,n). Then, by Fubini's theo- 
rem, with joint measurabihty by Lemma 111. 141 

E«X,c/XX,/i» =¥.^^X{t,uj)g{t)X{u,u)h{u)Aii{t)dii{u) 
E{X{t)X{u))g{t)h{u) dfi{t) dfi{u) 



II' 



The same apphes to Y. Consequently, if (iii) holds, then K{(^X, g}(X, h}) = 
E{(Y,gXY,h}), which is ([L3]) for L'^{K,ii) (with k = 2). Hence Corol- 
lary EH yields EX®2 = Ey®2 in L2(K,/i)®2. Furthermore, L^{K,fi) has 
the approximation property by Theorem 19.11 and thus E X®^ = E y®^ in 
L2(K,/x)®2 by Theorem ESI Consequently, 

Ea{X,X) = <a,EX®2> = <a,Ey®2> = Ea(y,y). 

Since a is an arbitrary bounded bilinear form on C{K), this completes the 
proof. □ 

Remark 11.24. Theorem 111.231 shows that, when K is metrizable, the mo- 
ment EX®2 (or EX®2) is determined by the moment function K{X{t)X{u)) 
as soon as the moment exists in Dunford sense. The corresponding result 
for A; = 1 is in Corollary 111.171 



Example 111.301 yields an example of a non-metrizable K such that (iii^ 
does not imply 



We leave it as an open problem whether Theorem 111.231 extends to ^ 3. 
In particular, for metrizable K and ^ 3, if EX®'^ or EX®^ exists in 
Dunford sense, does the moment function (|11.2p determine this moment 
uniquely? 

For projective moments of order k ^ 3, we do not know any special 
results for Pettis or Dunford integrability, but we have as always a simple 
result for Bochner integrability. (Recall that this implies Pettis and Dunford 
integrability, so we have a sufficient condition for them too.) 

Theorem 11.25. Let K be a metrizable compact space and suppose that 
X is a C -measurable C{K) -valued random variable. Then EX®^ exists in 
Bochner sense "EX^^ exists in Bochner sense E(sup(g;^ |X(t)|)'^ < 

00. 

Proof. Theorem 16.71 □ 



We end by a few counterexamples, partly taken or adapted from 2J] and 
[g^ I where further related examples are given. See also Examples 15.141 15.181 
and 15.191 which by Examples lll.lf[TT~4] can be seen as examples in some 
C{K). 
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Example 11.26. Let X be a C{K)-va\ued random variable such that KX 
exists in Dunford sense but not in Pettis sense, and let Y := r]X, where 
rj = +1 with the sign uniformly random and independent of X. Then Y is 
Dunford integrable and EY{t) = E{r]X{t)) = for every t e K, so EY{-) e 
C{K) but Y is not Pettis integrable (since otherwise X = rjY would be too). 
We may for example take X as in Example 15.141 [X e cq <^ c = C(N*), so 
IT = N* is metric) or as in Example 15.191 {X is bounded). (We cannot take 
both K metric and X bounded by Theorem 111.161 ) 

Example 11.27 (cf. [8, Section V.5]). Let T := [0,27r] (perhaps regarded 
as the unit circle) and N* := Nu {oo} (the usual one-point compactification 
as in Example lll.4p , and take K := T u N* , where we regard T and N* 
as disjoint. If / e C{K), define f{n) := ^ Jq'^ /(t)e^'"'* dt, i.e., the Fourier 
coefficients of /|t. 

Define the trilinear form a on C{K) by 

«(/, g, h) := Re J] f{n)g{n)h{n). (11.13) 

n=l 

By Holder's inequality and Parseval's identity, 

f; \f{n)g{n)h[n)\ ^ \\h\\ l/(t)p|j) (£ W)?^) ''^ ^11/11 U 

thus the sum in (jll.lSp converges and a is well-defined and bounded. 

Let be an N-valued random variable with f{N = n) = pn, let an 
be some positive numbers and define the random variable X e C{K) by 
X{t) := cos(A^t), t e T, and X{n) := a„eAr(n), n e N*. Then X{N) = \ 
and 

a{X,X,X) = X{XfaN = \aN. 

Hence, 

00 

E\a{X,X,X)\=\EaN = \Y,Vnan. (11-14) 

n=l 

Furthermore, \X(t)\ ^ 1 for t e T and E|X(n)|'^ = p„«n for n e N (and 
for n = oo). 

Choose, e.g., p„ := n~'^l'^ (for n large) and := n^/^. Then E |X(n)p 
as n — > cxD, and thus {|X(x)p : x e K\ is uniformly integrable. Hence 
E exists in Pettis sense by Theorem lll.161 On the other hand, E | a{X^ X, X) | 
CO by (I11.14P , and thus E X®^ does not exist (even in Dunford sense) . This 
shows that Theorem 111.2^ PKi^) ^^o^ hold for /c = 3. 

The example may be modified for any given ^ 3 by taking 

oc 

a(/i, . . . , A) := Re 2 h{n)hin)h{n) ■ ■ ■ fUn), (11.15) 

n=l 

and Pn = n^^''+^y^. 
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Example 11.28 (cf. [23, Example (2)] and [24, Example 5.5]). Let uji be 
the first uncountable ordinal and let K = [0,ti;i], the set of all ordinals ^ uji 
with the order topology. It is easily seen that K is compact. Note that 
K\{(jji] = [0,Li;i) is the (uncountable) set of all countable ordinals. 

It is not difficult to see that every / e (7[0,li;i] is constant on [a,a;i] for 
some a < uji. Hence, the Baire cr-field Ba on [0,a;i] is the cr- field consisting 
of all subsets A such that either A or its complement A"^ is countable. 

Furthermore, every bounded increasing function / : [0,a;i] ^ M is con- 
stant on [a,a;i) for some a < oji. It follows (by considering the positive 
and negative parts) that every regular signed Borel (or Baire) measure on 
[0,a;i] is supported on some set [0,a] u {wi}; hence every regular signed 
Borel measure has countable support and is thus discrete. Consequently, 
C[0,u;i]* =£i[0,u;i]. 

We define a probability measure P on ([0, wi], Ba) by setting T{A) = if A 
is countable and T{A) = 1 if is countable. The mapping X : '■= 
1[„ ,^^] maps (17, Ba,P) ^ C[0,a;i]. If /3 < wi, then Xo,{(3) = l{a ^ /?} = 
for a.e. a, while Xa{LjJi) = 1 for all a. In other words, X(/3) = a.s. if 
P <uji but X{oji) = 1. 

We have seen that any x* e C[0,(xii]* is given by 

^*(/) = 2e(«)/(«) (11.16) 

a 

for some i e ^^[0,a;i]. (Note that the sum really is countable.) It follows 
that in this case, 

x*{X) = i{LOi) a.s. (11.17) 

Consequently, X is weakly measurable, and since X further is bounded, the 
Dunford integral EX exists. We have, by (I11.17p . 

<EX,x*> = E<j;*,X> = ^(wi), (11.18) 

when X* is given by (IlLlGh . Consequently, EX is given by the function 
'^{uii] that is 1 at uoi and on [0,(^i). This function is not continuous, and 
thus EX ^ C[0,a;i], which shows that X is not Pettis integrable. 

By Theorem l5.81 X is not weakly a.s. separably valued. (This is also easily 
seen directly. If M is any separable subspace of C[0,wi], then there exists 
an a < wi such that every function in M is constant on [a,a;i]. Hence, 
XiM a.s.) 

Note that Example 111.281 gives a uniformly bounded continuous random 
function X{t) such that EX(t) is not continuous. This cannot happen on 
a metric space K, since dominated convergence shows that EX(t) always 
is sequentially continuous. (Indeed, if X is a uniformly bounded random 
variable in C{K) with K compact metric, then Theorem 111.161 applies and 
shows that all injective moments exist in both Bochner and Pettis sense.) 



Example 11.29 ([29( and [6|). Recah that = Cfe(N) ^ C7(/3N) where /3N 
is the Stone-Cech compactification of N, see Example lll.li Furthermore, 
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/3N can be regarded as the subset of the unit ball of (^°°)* consisting of 
all multiplicative linear functionals on P\ (This holds also as topological 
spaces, with the weak* topology on (^°°)*.) A point n e N then is identified 
with the multiplicative linear functional (5„ : / i-^ /(^)- 

Let X^^^ and X^^^ be two independent copies of the random variable 
X e = C(/3N) constructed in Exampl e [5ltl and let Y = X^^^ - X^^). 
We follow Fremlin and Talagrand [29'] and Talagrand (62 . Theorem 4-2-5] to 
show that Y is Pettis integrable. (Recall from Example 15. 191 that X is not.) 

The coordinates Yn are i.i.d. random variables, each with the distribution 
of r]i — r]2 with independent r/i,r/2 ~ Be(l/2); hence Yn has the centred 
binomial distribution Bin(2, 1/2) — 1. It follows that ■\/2Yn is an orthonormal 
sequence in L^(P). Consequently, by Bessel's inequality, if ^ e L°°(P) 1= 
L2(P), then the sequence y^. := (E(^y„))«^ efc cq. 

If X* = {an)f e f, then by Fubini, 
00 00 
(x^y^y = 2 anmYn) = E 2 an^Y^ = E{^(x*,Y}). (11.19) 

If X* e Cq , then x*{X'^^'^) and x*(X(^)) are by Example 15.191 equal to some 
constant a.s., and thus x*{Y) = x*{X^^^) — x*(X(^)) = a.s. Furthermore, 
= since y^ e cq, and thus (|11.19p holds in this case too. Hence, 
(|11.19l) holds for all x* e (£")*, and every ^ e L"°(P), which shows that Y 
is Pettis integrable and ]E(^1^) = y^. 

Consider now the injective second moment E y®^. Assume that this exists 
as a Pettis integral; it then belongs to C(/3N)(g)C(/3N) = C((/3N)2). Let us 
write Q := Ey®^ ^ C{{^nf). If x* e ^N\N, then x* e 4, and thus 
x*(y) = a.s.; consequently, 

Q(x*,x*) = <x*®x*,Ey®2> = E<x*(x)x*,y®2> = E<x*,y>2 = 0. (11.20) 

On the other hand, if n e N, then, similarly, 

Q(n,n) =<5„®5„,Ey®2> = E<,^,®5„,y®2> = E<5„,y>2 = i, (11.21) 

since <(5„,y> = Yn Bin(2, \) - 1. However, N is dense in /3N, so (111.2111 
implies by continuity that Q(x*,x*) = ^ for all x* e /3N, which contradicts 

(|11.20p . Consequently, the second moment Ey®^ does not exist as a Pettis 
integral. (We do not know whether it exists as a Dunford integral.) 

Example 11.30. Let B := ^°°/co. We identify and C(/3N), see Exam- 
ple [iLll then Co = {/ e C(/3N) : /(x) = when x e /3N\N}, and it follows 
by the Tietze-Urysohn extension theorem (27l . Theorem 2.1.8], since N is 
open in /3N, that we can identify B = ^°°/co = C(/3N\N). (This can also 
be seen from Example 111.31 since /3N\N is the maximal ideal space of the 
complex version of I'^/cq.) 

Let TT : i'^ ^ ^°°/co be the quotient mapping. (Thus vr is identified 
with the restriction mapping C(/3N) C(/3N\N).) Let X be the weakly 
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measurable £°°-valued random variable constructed in Example 15.191 and let 
X = Ti{X) e rjcQ = C(/3N\N). Finally, let Z:=\-X. (Thus ^ Z ^ 1.) 

Then X and Z are bounded and weakly measurable C(i^')-valued random 
variable, with K = /3N\N. By Example EISl if x* e if = /3N\N, then 

X{x')=X{x*)={x*,X) = \ a.s. (11.22) 

Hence, 

Z{x*) = a.s. (11.23) 

for every x* e K and 

E(Z(x*)...Z(4)) =0 (11.24) 

for any , . . . , x^, e if = /3N\N, so the function defined in (111.2P exists and 
is continuous on (in fact, constant 0). 

However, let x* e (^'")* be defined by <x*, (ai)i> := ^Xi"=iai, and let 
T : ^ be the linear map x (x*(x))„. Choose any Xq e /3N\N and 
define x* e (^*)* as T*x^. i.e., by 

'(x*,x) := {xo,rx) = {xg, (x*(x))n), X G 

If X e Co, then x*(x) — > as n — > oo, and thus Tx = (x*(x))„ e cq, so 
{x*,x) = {xq,Tx) = 0; hence, x* _L cq, and x* e {i°°/co)*. Furthermore, by 
the law of large numbers, (x* , X) = ^ Xi^^i -^i ^ k ^^"^ thns 

<5*, X> = <x*, X> = i a.s. (11.25) 

and 

<x*,Z> = <x*,l-X> = l-<x*,X> = i a.s. (11.26) 

For k = 1, M Z exists in Dunford sense, since Z is bounded and weakly 
measurable; (|11.26p implies that {x*, E Z) = E{x*, Zy = ^ and thus E Z 7^ 0, 
although (111.231) shows that (EZ,6t) = E(Z(t)) = for every t e K. In 
particular, it follows that EZ e C{K)**\C{K), and thus Z is not Pettis 
integrable. (Cf. Example 15.191 which shows that EX does not exist in Pet- 
tis sense by essentially the same argument.) We see also that (Ill.Sp fails 
for Z and fi = x*; hence, as said in Remark 111.181 Z{t,uj) is not jointly 
measurable. 

For k ^ 2, we do not know whether EZ'^^ or EZ®*^ exists in Dunford 
sense, but they do not exists in Pettis sense, by an extension of the argument 
for E Z. Indeed, if E Z®*^ exists in Pettis (or just Dunford) sense, then by 
(|11.25p . with X* as above, 

<(x*)®^EZ®^> = E<x*,Z>'= = (i)^ (11.27) 

so EZ®'^ ^ 0. On the other hand, by (111.241) . 

<<5ti(x)---(x)(5t,,EZ®'=> = E(Z(ti)---Z(tfc)) =0 (11.28) 

for all ti,...,tk e K. Suppose that EZ®'= exists in Pettis sense. Then, 
by Theorem [UTOl EZ®'' is the function (fTOD on K'', i.e., by (fTOS]) . 
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E^®^ = 0, a contradiction. Hence, EZ®'^ does not exist in Pettis sense. 
This also shows that Theorem 111.191 does not hold for K = /3N\N. 

Example 11.31. Let Z e ^°°/co and x* e (£°°/co)* be as in Example [JOUl 
Let ^ ~ Be(l/2) be independent of Z, and define Zi := £_Z e I'^/cq = 
C(/3N \N). 

By (fTOHl) . Zi(x*) = a.s. for every x* e K = /3N\N. On the other hand, 
by dTOGj), 

<x*,Zi> = e<5*,Z> = a.s. (11.29) 

Define the measure on the cr-field C as the distribution of Zi, and 
regard the random variable Zi as defined by the identity map C{K) 
C{K) on the probability space {C{K),C*,n), where C* is the completion 
of C. (Recall that we want our probability space to be complete.) This 
version of Zi is C-measurable. If ^p{Zi) is any measurable functional, then 
(/9 is a C*-measurable function on C{K), and thus (p is ^u-a.e. equal to a 
C-measurable function -0 on C{K). By the definition of C, this implies that 
■(/;(/) = ^'(/(ti), f{t2), . . . ) for some function F on and some sequence 
of points ti e K. By (|11.23p . each Zi{ti) is a.s. constant, and thus ip{Zi) 
is a.s. constant; since '■p{Zi) = tp{Zi) a.s., also (p{Zi) is a.s. constant. Since 
x*{Zi) is not a.s. constant by (jll.29p . x*{Zi) is not measurable; hence Zi 
is C-measurable but not weakly measurable. It follows that C 7^ Bw 

Example 11.32. For another (simpler) example with C 7^ Bw, let X := 
{0, 1}'^^, where Ci = 2^ (or any cardinal number > c), and let as in Exam- 
ple [5TT9]// be the product measure fi := (^(5o + ^(^1) ^ 

Suppose that the linear functional / 1— > x(^) '■= ■^'^^ ^® C-measurable. 
Then there exist points ti e K, i = 1,2,..., and a (measurable) function 
$ : M°° ^ M such that 

f /dAi = $(/(ti),/(t2),...), f^CiK). (11.30) 

JK 

Each t e K is a function ci {0, 1} which we denote by a 1-^ t{a). Define 
an equivalence relation on ci by /? s 7 ti{/3) = ^1(7) for all i. The 

number of equivalence classes is 2^° = c < Ci, and thus there exists /3, 7 e ci 
with f3 ¥= "J but /3 = 7. 

Consider the normalized coordinate functions fait) := 2t{a) — 1 : K ^ 
{-1, 1}, a e ci. Since /3 = 7, f/^iti) = fy{ti) for each i, and thus /;3(ti)/^(ti) = 
1. Consequently, if g := faf-/ and h := 1, then g,h e C{K) and g{ti) = h{ti) 
for each i, so by (jll.SOp 

f gd^Ji = ^{g{tl),g{t2),...) = ^{h{tl),h{t2),...)= f /id^, 

which is a contradiction since J^d/i = and ^^d^ = 1. 

This contradiction shows that the continuous linear functional x is not 
C-measurable, and thus Bw 2 C. 
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12. co(5) 

In this section we consider B = co{S), for an arbitrary set S. As dis- 
cussed in Example 111.41 we can regard co{S) as a complemented subspace 
of codimension 1 in C(5*) = C{S u {oo}): co(S) = {/ e C{S*) : /(oo) = 0}. 
(The results below could easily be formulated for C(5*) instead, but we 
leave that to the reader.) 

Note that co{S) is separable (and S* metrizable) if and only if S is count- 
able. (The discrete space S is always metrizable, but that is not enough.) 
The case when S is countable is thus covered by the results (for C{S*)) 
in Section [TTJ We shall see that these results extend to arbitrary S be- 
cause of the special simple structure of co{S). This illustrates that some 
non-separable Banach spaces can be handled without problems, and it is a 
background to Sections [T5HT61 where we (by technically more complicated 
arguments) obtain similar results for Z)[0, 1], which is more important for 
applications. 

Theorem 12.1. The injective tensor product co{S) = co(5''^) (isometri- 
cally). Moreover, cq{S) has the approximation property, and thus co(S')®'^ c 
co{S)'^^ = co(S''^) (as a vector space). 

Proof. An easy consequence of Theorems 111.61 and 111.51 applied to C{S*). 

□ 

The dual space 00(5*)* = ^^{S). Note that every element in £^{S) has 
countable support. Thus every x* e co{S)* depends only on countably 
many coordinates. This extends to multilinear forms as follows. For a 
subset j4 c 5, let Pa be the projection in co{S) defined by 

PAf{x):=l{xeA}f{x). (12.1) 

Lemma 12.2. If S is any set and a is a bounded k-linear form on co{S), 
then there exist a countable subset A <^ S such that 

a{fi,...Jk) =a{PAfi,...,PAfk). (12.2) 

Proof. Write, for convenience, 

a(si, . . . ,Sfc) := a(esi, . . . ,esj^), si, . . . , Sfc e S. (12.3) 

Fix a finite set F <^ S and let X e cq{S) be random with X{s), s e F, 
i.i.d. with P(X(s) = +1) = ¥{X{s) = -1) = i, while X{s) = for s ^ F. 
Let Xi, . . . , Xk be independent copies of X. Then 

a{Xi, . . . ,Xk) = ^ a{si, . . . ,Sk)Xi{si) ■ ■ ■ Xk{sk) 

si,...,SfcSF 

and thus, since different terms are orthogonal, 

E\a{Xi,...,Xk)f = 2 \a{si,...,Sk)\^. 

si,. ..,Si.eF 
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Hence, 

^ |a(si,...,Sfe)|^ ^ \\af. 

si,...,SkeF 

Since this holds for every finite F, 

2 Hsi,...,Sk)f ^\\af. (12.4) 

si,...,SfeG5 

In particular, only a countable number of a(si, . . . , Sk) are non-zero. Hence 
there exists a countable subset A oi S such that a{si, . . . ,Sk) = unless 
si, . . . , Sfc e A. Then (|12.2p holds for every /i, . . . , /fc with finite supports, 
and the general case follows by continuity. □ 

Remark 12.3. Bohnenblust and Hille proved the stronger result 

2 K.i,...,.,)|2V(^+l)<00, 
si,...,Sfce5 

where the case A; = 1 is just co{S)* = i^{S) and k = 2 had been proved 
earlier by Littlewood (3]; see also [3]. 

The integral forms are, by definition, the elements of the dual of co(S')®'^; 
by Theorem 1 1 2 . II this equals co{S'^)* = i^{S^). Consequently, every integral 
A:-linear form on co{S) is nuclear. 

We let, as in Section [Til C be the cr-field generated by the point evalua- 
tions. Thus, a co(S')-valued random variable X is C-measurable if and only 
if X(s) is measurable for every s e S. 

Theorem 12.4. The a-fields C and Bw on cq{S) coincide, for any S. 
Moreover, the following hold for any cq{S) -valued random variable X: 

(i) X is weakly measurable if and only if X is C-measurable. 

(ii) If X is C-measurable, then there exists a countable subset Sq '^^ S such 
that for every s ^ Sq, X{s) = a.s. 

(iii) IfX is C-measurable, then X is weakly a.s. separably valued. Moreover, 
then X®^ is weakly a.s. separably valued in Co{S)®^ and cq{S)®^ for 
every k ^ 1. 



Note that (i) is proved for any separable C {K) in Corollary 111.151 but 
here cq[S) may be non-separable. 

Proof. Since cq{S)* = £^{S), and every element of i^{S) has countable sup- 
port, it follows that B^j is generated by the point evaluations, i.e., that 
= C. 



(i) This is immediate from B^u = C. 

(ii) : Suppose that X is C-measurable, and let, for 6,e > 0, 

Ss,:={seS:F{\X{s)\>6)>e)}. 

Suppose that Sse is infinite for some 6,e > 0. Fix these 6 and e, and let 
Si, i = 1,2,..., be an infinite sequence of distinct elements of Sse- Let 
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N := > ^} be the number of points Si where \X\ > 6. Since 

X e 00(5*), is a finite random variable, and thus there exists M < cc such 
that P(A^ > M) < e/2. It follows that for every Si, 

E{l{\X{si)\ > 6}1{N ^ M}) = F{\X{si)\ > 6) and iV ^ M) 

^ F{\X{si)\ > 6)) - F{N > M) > e/2. 

Summing over all i we obtain the contradiction 

00 00 
M ^ E(iVl{Af s$ M}) = 2 E{l{\X{si)\ > 6}1{N ^ M}) ^2^/2 = ^■ 

i=l 1=1 

Consequently, each Sse is finite. Let 5*0 = lJn=i '^n^^n^^- Then 5*0 is a 
countable subset of S and if s ^ Sq, then X{s) = a.s. 

Let 5*0 be as in (ii) and let Bi := {/ e co(5) : supp(/) c 5o}. 



m, 



Then Bi is separable. Moreover, if x* e co{S)* = i^{S) with x* -L -Bi, then 
X* = (a(s)) e i^{S) with a{s) = for s e 5o and thus, since {s : a{s) ^ 0} is 
countable, 

x*(X) = Yi a{s)X{s) = a.s. 

s^So 

Thus X is weakly a.s. separably valued. 

More generally, if /c ^ 1, then Bf^ is a separable subspace of co{S)®^. 
Suppose that a e (co(S')®'=)* with a 1 Bf". By Theorem S^l a is a 
bounded multilinear form C(){S)'' M. Let A be the countable subset given 
by Lemma 112.21 

Since A is countable and X{s) = a.s. for s e ^yS'o, PaX = PAnSo^ e Bi 
a.s., and thus a.s. 

<a, X®'^) = a(X, ...,X)= a{PAX, . . . , P4X) = <a, (^4^50^)®') = 0. 

This hold for every a _L B^^ , and thus X®'^ is weakly a.s. separably valued 
in co{S)®^. Since i : 00(5)®^ cq{S)®^ is continuous, X®'' is weakly a.s. 
separably valued in co(5)®'^ too. □ 

However, X is not always a.s. separably valued; consider for example 
X := eu e co[0, 1] where U ~ U(0, 1). (Cf. Example \1A\ where we consider 
a similar random variable in £^[0, 1].) 

Theorem 12.5. If X is a random variable in cq{S), then X is a.s. sepa- 
rably valued if and only if there exists a countable subset A <^ S such that 
supp(X) ^ A a.s. 

Proof. If A is countable, then {/ e 00(5*) : supp(/) c ^} is a separable 
subspace of co(5); conversely, every separable subspace of 00(5") is included 
in some such subspace with A countable. □ 

Theorem 12.6. Suppose that X is a C-measurable co{S) -valued random 
variable. Let k ^ 1. 
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(i) KX'^^ exists in Dunford sense <s=> the weak k:th moment exists 
^jnVseS^\X{s)\'' < 00. 

(ii) ¥,X®^ exists in Pettis sense the family {\X{s)\^ : s e S} of 
random variables is uniformly integrable <«=^ E|X(s)|*^ e 00(5"). 

(iii) KX^^ exists in Bochner sense E(supj,g_5 |X(s)|)'^ < go and there 
exists a countable subset A <^ S such that supp(X) ^ A a.s. 

If EX®*^ exists in Bochner or Pettis sense, then it is the function in cq{S)®^ = 
co{S'') given by 

EX®^(si,...,Sfc) =E(X(si)---X(sfc)). (12.5) 

Proof. The proof of Theorem 111.161 holds with a few minor changes; we 
use Theorems Ei giliif c) | gZi^iii)] and MM and note that (fTL6]l and (fTTTm 
hold without measurability problem since fi now is a discrete measure with 
countable support. 



Moreover, for (ii) if s„ is any sequence of distinct elements in S, then 
|^('Sn)|'^ — > as n — > 00. Hence, if {|X(s)|'^ : s e 5"} of random variables is 
uniformly integrable, then E|X(sn)|'^ — > 0, and it follows that E|X(s)|'^' e 
co{S). The converse is obvious. 

Finally, (fT23]l follows as in Theorem dLlOl □ 

There is an obvious analogue of Corollary 111.171 which we leave to the 
reader. Note that (jll.Sp holds for 00(5*), even when this space is non- 
separable, because each in ()11.9p has a countable support. 

For the second projective moment, we can again use Grothendieck's the- 
orem, and obtain the following version of Theorem 111.221 

Theorem 12.7. Suppose that X is a C-measurable CQ{S)-valued random 
variable. 

(i) EX®^ exists in Dunford sense EX®^ exists in Dunford sense 

the weak second moment exists sup^g^E |X(s)p < 00. 

(ii) EX®^ exists in Pettis sense EX®^ exists in Pettis sense 
E|X(s)|2 e cq{S). 

(iii) EX®^ exists in Bochner sense EX®^ exists in Bochner sense 

E(supgg5 |X(s)|) < 00 and there exists a countable subset A<^ S 
such that supp(X) ^ A a.s. 

Proof. For any given bounded bilinear form a on cq{S), there exists by 
Lemma 112.21 (or by Theorem lll.20p a countable subset So of S such that 
a{f,g) depends only on the restrictions of / and g to Sq. Thus a can be 
regarded as a bilinear form on 00(5*0), and can be extended to C{Sq), and the 
proof of Theorem 111.221 applies . again using Theorems [I24);iii) | and MM □ 



It is now easy to see that Theorems 11.31 and 111.231 hold for C-measurable 
random variables in 00(5"); we leave the details to the reader. 

The results above show that the space 00(5*) behaves very well even when 
S is uncountable. However, the following example shows that the moments 
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may be degenerate. We note also (Example I12.9P that the norm of a weakly 
measurable random variable in cq{S) may fail to be measurable. 

Example 12.8. Let B = co[0,l] and X = ec/, C/ ~ U(0,1). (Cf. Exam- 
ple [M) 

Let a be a bounded /c-linear form on co[0, 1], and let A c; [0,1] be a 
countable set as in Lemma \TT2[ Since PiPA^ ^ 0) = F{U e ^) = 0, it 
follows from (fTO) that 

<a,X®'=> = a(X,... ,X) = a.s. 

Consequently, every projective moment EX®'' exists in Pettis sense, with 
EX®'' = 0, for every k ^ 1. Hence also the injective moments exist in Pettis 
sense with EX®'' = 0. (No moment exists in Bochner sense, since X is not 



a.s. separably valued, see Theorems 112.51 and \12.t \m 



Example 12.9. We modify Example 112.81 bv still taking B = co[0, 1] but 
now, as in Example 17.41 X = a(U)eu where a : [0, 1] — > (0, 1] is a non- 
measurable function. Then X is weakly measurable, as in Examples 17.41 and 
112. 8t but ||X|| = a{U) is not measurable. 

13. D[0, 1] AS A BANACH SPACE 

Recall that D = D[0, 1] denotes the linear space of functions [0, 1] —> M 
that are right-continuous with left limits, see e.g. @, Chapter 3]. Li other 
words / e -D[0, 1] if lim^^t /(s) = f{t) for every t e [0, 1), and furthermore 
the left limit of / at t, which we denote by 

/(t-) :=lim/(s), (13.1) 

s/t 

exists for every t e (0, 1]. We further define 

A/(t):=/(i)-/(t-), (13.2) 

the jump at t. We may for completeness define /(O— ) := /(O) and thus 
A/(0) := 0. 

It is easily seen that each function f e D is bounded. Hence ||/||d '■= 
suPte[o,i] |/(*)| defines a norm on D; the resulting topology is the uniform 
topology on D, see II, Section 15]. The norm is complete, so is a Banach 
space. Note that D is not separable, since the uncountable set of functions 
* ^ [0)1]) s-ll have distance 1 to each other; this leads to measura- 
bility problems when we consider values random variables, as discussed 
in Example 13.51 and 0, Section 15]. Note also that the (separable) space 
C = C[0, 1] of continuous functions on [0, 1] is a closed subspace of -D[0, 1]. 
The following relation between D[0, 1] and C[0, 1] was proved by Corson 
[13, Example 2]. 

Theorem 13.1 (^]). A is a bounded linear map of D[0,1] onto co(0, 1], 
with kernel C[0, 1] and norm \\A\\ = 2. Furthermore, for any f e D[0, 1], 

|lA/^(o,i] =2inf{ll/ + /ib[o,i] :/ieC[0,l]}. (13.3) 
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Hence, A can he regarded as an isomorphism D/C co(0, 1] and is an 
isometric isomorphism D/C co(0, 1]. 

Proof. It is well-known that f ^ D implies A/ e co(0, 1], but for complete- 
ness we repeat the proof: Given e > 0, for every x e [0, 1] we may find 
an open interval Ux = {x — 6x,x + 6x) such that — fix)\ < e/2 for 

ye {x,x + 6x) and — f{x—)\ < e/2 for ye {x — 6,x). (We consider only 
y e [0, 1], and ignore y e Ux\[0, 1], if such points exist.) Hence, |A/(y)| ^ e 
for y E Ux\{x}. Since [0, 1] is compact, it can be covered by a finite set of 
such intervals Uxi, • • • , Ux„, and then {y : Af{y) > e} c {xi, . . . , Xn}- Since 
e > is arbitrary, this shows that A/ e co(0, 1]. 

Hence A : L)[0, 1] co(0, 1]. It is obvious that A is linear and that 
/eker(A) <^ /eC[0, 1]. Furthermore, ||A/||co ^ 2||/||z). The function 
/o(x) := l[i/2,i) - l[o,i/2) in D has ||A/o||co = 2 = 2||/o||z), showing that 
equality can hold and thus ||A|| = 2. 

If 5 e coo(0, 1], let supp(g) = {xi, . . . , x„} with < xi < • • • < x„ ^ 1. 
Let / be the function in D that is constant on [0,xi) and linear 
on each [xi,Xi+i) for 1 ^ i < n, and satisfies f{xi—) = —g{xi)/2, f{xi) = 
g{xi)/2, 1 ^ z ^ n. Then Af = g and ||/||d = ^\\g\\co{o,i]- (The case 5 = 
is trivial; take / = 0.) 

For an arbitrary g e co(0, 1] and e > 0, we can find g„ e coo(0, 1] such 
that g = J^'^^^gn and 11^=1 |l£?n!Ico(o,i] ^ ll9llco(o,i] + £• Taking /„ e L» 
as just constructed with A/„ = gn and ||/n,||D = 5ll5n||co(0,i]) see that 
/ := fn^D satisfies Af = Xi^=i 9n = 9- Hence, A is onto. Moreover, 

00 -j^ 00 ^ ^ 

WfWn ^ 2 ll/n||D = 2 S ll5n||co(0,l] ^ 2^\9\\co{0,l] + 2" 
n=l n=l 

Consequently, 

inf{||/||z) : A/ = 5-} ^ IbWcoio,!], 
and since ||A|| = 2, we have equality: 

inf{||/b : Af = g} = ^||c/||co(o,i], 
which easily is seen to be equivalent to (|13.3p . □ 

Corollary 13.2 (Pestman [EH). Every continuous linear functional x ^ 
D[0, 1]* is given by 

x(/)= f /d/i+ 2 Kt)^fit) (13.4) 

te(0,l] 

/or some unique // e M[0, 1] and /i e ^-"^(0,1]; conversely, (|13.4p defines a 
continuous linear functional on D[0, 1] /or e?;er|/ suc/i /i and h. Furthermore, 

iIIxIId* ^ llAi||Af + \\h\\ii ^ 2||x||d*- (13.5) 

Note that the formally uncountable sum in ()13.4p really is the countable 
sum I]tesupp(h) h{t)Af{t). 
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Proof. It is clear that for any fi e M[0, 1] and h e i^{0, 1], ()13.4p defines a 
linear functional x with 

lx(/)l ^ ll/^IUf ||/||l> + ||/i||^i(o,i]l|A/llco(o,i] ^ (IIa^IIm + 2||/i||£1(o,i])||/||d. 

Hence, x ^ D* and ||xl|z)* ^ llA*llAf + 2||/i.||^i(o,i], showing the first part of 
(fT33D . 

Conversely, if x ^ -^*! then the restriction of x to C is a continuous 
linear functional on C, which by the Riesz representation theorem is given 
by a real measure /i e M[0, 1] with = \x\c ^ IIxIId- As just said, 

Xi(/) := /d/i defines a continuous linear functional on D, with ||xi||d* ^ 
\\iA\m ^ IIxIId and xi(/) = x(/) if / e C. Let X2 := X - Xi- Then X2 e D* 
and X2(/) = if / e C. Hence X2 can be regarded as an element of (D/C)*. 
By Theorem 1 13 -H 

{D/Cr^co{0,ir=£\0,l], 
using the isometric isomorphism ^A. Hence, there exists g e ^""^(0, 1] with 

ll5ll^i(o,i] = IIX2||(_D/c)* = IIX2||d* ^ IIxIId* + IIxiIId* ^ ^xWd* (13.6) 

and 

X2(/) = <5,|A/> = i 2 amfit). 

te(0,l] 

The decomposition ()13.4p follows with h = ^g; furthermore, by ()13.6p . 

II^IIa/ + ll^ll£i(o,i] ^ IIxIId* + IIxIId* = 2||xI|d*- 

Finally, to see uniqueness, suppose that fj. e M[0, 1] and h e i^{0, 1] are 
such that X defined by (jl3.4p equals 0. Then = xif) = So /d^ for every 
/ e C[0, 1], and thus ^ = 0. This implies further = xif) = Ht Kt)^fit) 
for every / e Z)[0, 1], and thus by Theorem 113.11 y]^ h(t)a(t) = for every 
g e co(0, 1]. Hence, h = 0. □ 

Remark 13.3. The decomposition (|13.4p can also be written 

xif) = C fit) dfiiit) + f fit-) d^^2it), (13.7) 
Jo Jo 

where //2 := ~l]xe(oi] ^i^)^x and /ii := /x — ^2- Conversely, every pair of 
measures /^i, /i2 £ -^[0, 1] defines a continuous linear functional x £ -D[0, 1]* 
by ()13.7p . However, this representation is not unique unless we impose 
further conditions (for example that /X2 is discrete with /U2{0} = 0, as in the 
construction above); note that S/(i)d/i(t) = \fit—)A^it) for every f e D 
and every continuous measure fi, since fit—) = fit) except on the countable 
set supp(A/). 

Remark 13.4. C[0, 1] is not a complemented subspace of D[0, 1], i.e. there 
does not exist a bounded linear projection P : D[0, 1] — > C[0, 1], see Corson 
[l3 . Example 2]. Equivalently, there does not exist a right inverse of A, 
i.e., a bounded linear map T : co(0, 1] — > D[0, 1] such that ATg = g for 
every g e co(0, 1]. (The equivalence is standard, and follows because we can 
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factor I — P through D/C = co(0, 1] and thus define T by TA = I — P, and 
conversely.) 

To see this, suppose that such a map T exists. Then g ^ Tg{t) is a 
bounded linear functional on co(0, 1] for every t e [0, 1], and is thus given 
by some ht e ^^(0, 1]. Let N := UisQnp i] supp(/i(). Then is countable, 
so there exists s e (0, 1]\A^. Consider es{t) := l{t = s} e co(0, 1]. Since 
supp(es) = {s} is disjoint from supp(/i() for all rational t, it follows that 
Tes{t) = (cs, ht) = for all rational t. Since Teg e -D[ 0, 11 , this implies that 
Tcg = 0, which contradicts ATe^ = e<j. (See Corson [ij, Example 2] for a 
different proof.) 

Nevertheless, Corollary 113.21 shows that C[0, 1]* = M[0, 1] embeds as 
a complemented subspace of Dp, 1]*, and we have D[0,1]* = C[0, 1]* © 
co(0, 1]*. The crucial fact is that each bounded linear functional x on C[0, 1] 
extends in a canonical (linear) way to a bounded linear functional on -D[0, 1], 
because x is given by a measure // e M[0, 1] and we can define the extension 
by J / d/i for any f e D. (This is similar to the decomposition (£")* = CqQcq 
since Cq = embeds into (^°°)*.) In general, a closed subspace Bq of 
a Banach space i? is said to be weakly complemented if its annihilator is 
complemented, i.e. if there is a projection P : B* ^ Bq] it is easy to see 
that this is equivalent to the existence of a bounded linear map i : -Bq — > B* 
such that ix* is an extension of x* for every x* e Bq, and then B* = 
i{B*) ®B^ ^ B* B^. Thus C[0, 1] is a weakly complemented subspace 
of L'[0, 1]. (And Co is a weakly complemented subspace of in fact, cq is 
a weakly complemented subspace of any Banach space B 3 cq.) 

14. ^[0, 1] AS A Banach algebra 

The product of two functions in D[0, 1] is also a function in -D[0, 1], and 
thus -D[0, 1] is a commutative Banach algebra. In order to use the general 
theory of complex Banach algebras (which is much more satisfactory than 
the theory for real Banach algebras), we consider in this section -D[0, 1] as a 
complex space, consisting of all complex-valued right continuous functions 
on [0, 1] with left limits. The results below will be proved for this case, but 
it follows immediately that they hold for the real case too, by considering 
the subset of real-valued functions. 

The (complex) Banach algebra -D[0, 1] has an involution given by / i— > /, 
and obviously ||//|| = ||/p, so L'[0, 1] is a commutative C*-algebra. As 
said in Example lll.3( every such algebra A is isometric to the space C{K) 
of continuous functions on its maximal ideal space K, see e.g. |l3l . Chapter 
VIII. 2]. The maximal ideal space can be described as the set of all (non- 
zero) multiplicative linear functionals (i.e., homomorphisms) h : A —> C 
with the weak*-topology (in this context known as the Gelfand topology), 
and the isometry A — > C{K) maps / e ^ to the function f : h ^ h{f) on 
K; moreover, K \s a, compact Hausdorff space. 

In the case of -D[0, 1], the maximal ideal space has a simple description. 
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Theorem 14.1. The linear homomorphisms on D[0, 1] are given by f *-> 
f{t), t e [0, 1], and f ^ f(t^), t e (0, 1]. The maximal ideal space I thus 
consists of two copies, t and t—, of every point in (0,1], together with a 
single 0. 

Proof. This is a simple adaption of the standard argument for the Banach 
algebra of continuous functions on a compact set. The mappings / i— > f{t) 
and / ^ f{t^) are non-zero homomorphisms, and they are obviously all 
distinct. 

Suppose that there exists another homomorphism h : D[0, 1] C, and 
let M := ker(/i); thus M is a maximal ideal in Z)[0, 1]. Since h differs from 
all / ^-> f{t) and / ^ f(t—), there exists for each t e (0,1] two functions 
ft+,ft- £ M such that ft+{t) 7^ and ft-{t—) 7^ 0. By taking a suitable 
linear combination of ft+ and ft- we see that there exists ft e M such that 
ft{t) 7^ and ft{t—) 0; thus there exists an open set Ut such that t e Ut 
and l/f I is bounded below in Ut- For t = we directly find /o with /o(0) ¥= 
and thus an open set Uq with e C/q and /o bounded below in Uq. 

The sets Ut form an open cover of the compact set [0, 1], and thus there 
exists a finite set {ti, . . . , tn} such that IJ^^i — [0' "^^^ function F := 
Yd=i \fk? = I]"=i fkh e since M is an ideal, and inf^p,!] F{t) > 0, by 
the construction. Hence l/F e D[0, 1], and 1 = F ■ {l/F) e M, which is a 
contradiction. 

(Alternatively, one can use the description in Corollary 113.21 of the con- 
tinuous linear functionals and show that (jl3.4p is multiplicative only in the 
cases given in the theorem.) □ 

We give / the Gelfand topology, i.e., the topology generated by the func- 
tions / : / ^ C; as said above / is compact. By Theorem 114. 1^ the points 
in I are of two types, t and t—; we call the points t ordinary. (We may for 
symmetry define t+ = t; then I = {t+ : < t ^ 1} u {0}. We shall use 
the notation t+ for the ordinary points in I when we want to distinguish 
between i -I- as an element of / and t as an element of [0,1].) We may thus re- 
gard [0, 1] as a subset of /, consisting of the ordinary points. (But note that 
[0, 1] does not hav e the subspace topology.) We then have D[0, 1] = C{I) 
as noted by Edgar 23 . Example 5.7] (and possibly known earlier); we state 
this in detail: 

Theorem 14.2. D[0, 1] = C(l). More precisely, each function f e D[0, 1] 
extends to a unique continuous function on I, with f{t—) given by (jlS.ip . 
and, conversely, if f is a continuous function on I , then the restiction to 
the ordinary points t e [0, 1] is a function in D[0, 1]. 

Proof. This is just a reformulation of the fact that the Gelfand transform 
/ t-^ / is an isomorphism D[0, 1] — > C(/), using the description of / in 
Theorem [HTl □ 

Corollary 14.3. D[0, 1] has the approximation property. 
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Proof. In fact, C(A') has the approxhnation property for every compact K, 



The topological space / is called the split interval or two arrow space. 
(Actually, this name is often used for a modification of / obtained by either 
adding an extra point 0— or deleting 1; both modifications are symmetric 
with a natural involutive homeomorphism t+ i— > (1 — + 

Note that there is a natural total order on /, with x < y— < y when 
x,y e [0,1] with x < y. (This is the lexicographic order, if we regard / as 
a subset of [0, 1] x { — ,+}.) We define intervals in / in the usual way, using 
this order. Recall that any totally ordered set can be given a topology, the 
order topology, with a base consisting of all open intervals {-co, a), (a, co), 
and (a, 6), see e.g. |2^, Problems 1.7.4 and 3.12.3]. 

Recall that a compact Hausdorff space is totally disconnected or zero- 
dimensional if it has a base consisting of open and closed sets, and extremally 
disconnected if the closure of every open set is open. (These notions are 
used also for non-compact spaces, but then "totally disconnected" is used 
in several, non-equivalent, meanings, coinciding for compact spaces, see e.g. 



Theorem 14.4. The compact Hausdorff topology on I equals the order 
topology. The space is totally disconnected hut not extremally disconnected. 

Furthermore, 1 is isolated (i.e., {1} is open), each t e [0,1) has a neigh- 
bourhood base consisting of the intervals \t,u), u > t, and each t— has a 
neighbourhood base consisting of the intervals [u,t—], u < t. These neigh- 
bourhood bases consist of open and closed sets. 

For t—, there is an alternative neighbourhood base consisting of the inter- 
vals (n, t—]; these sets are open but not closed. (Symmetrically, the intervals 
[t,u—) form another open neighbourhood base at t.) 

Proof. We first consider the order topology and note that the given collec- 
tions of sets are neighbourhood bases; this is easily seen since [t, u) = (t— , n), 
[n,t— ] = {u—,t) and {1} = (1 — ,go), with the interpretation {0—,u) = 

(— 00, ti). 

In particular, these intervals form together a base for the order topology. 
If J is any of these intervals, then Ij is a function on / whose restriction 
/ to [0, 1] belongs to D[0, 1], and it is easily verified that / = Ij. Hence, 
by Theorem 114.21 Ij e C{I), and thus J is open and closed in / with the 
Gelfand topology. This shows that the Gelfand topology is stronger than 
the order topology. Since the Gelfand topology is compact and the order 
topology Hausdorff, the topologies coincide. 

We have seen that the given base consists of open and closed sets; hence 
the space is totally disconnected. On the other hand, U = \^^^^[l/{2n), l/(2n— 
1)) is an open set whose closure U = U vj {0} is not open; hence I is not 
extremally disconnected. □ 




□ 



0.) 
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Corollary 14.5. The compact space I is separable and first countable (each 
point has a countable neighbourhood base), but not second countable (I does 
not have a countable base). 

Proof. I is separable, since the rational numbers are dense. 

We obtain countable neighbourhood bases by taking rational u only in 
the intervals in Theorem 114.41 

On the other hand, if {Ua} is a base for the topology, then each set [t, 1], 
which is open, contains some Ua(^t) with t e Ua(t) ■ Then t = min Ua(t) i and 
thus the sets Ua(t) a-r^ distinct. It follows that every base contains (at least) 
c elements. □ 

Corollary 14.6. The compact space I is not metrizable. 

Proof. A compact metrizable space is second countable [13, Theorem 4.2.8]. 

Alternatively, this follows by Theorem 111.71 since C{I) = -D[0, 1] is not 
separable. □ 

Remark 14.7. The topology on I induces on the subspace [0, 1] the topol- 
ogy where {1} is open and each t e [0, 1) has a neighbourhood base consisting 
of the intervals \t,u), u> t. This (or rather the corresponding topology on 
M) is known as the Sorqenfre u li ne, and is a standard source of counterex- 



amples in topology, see e.g. [58[] and [27|, Examples 1.2.2, 2.3.12, 3.8.14, 
5.1.31]. 

For example, if / denotes [0, 1] with this topology, so / /, then / and 
I X I are separable, but I x I contains the closed subspace {{t,l — t)} which 
is discrete and uncountable, and thus not separable. (In particular, I x I 
cannot be metrizable, yielding a third proof of Corollarv 114.61 ) Moreover, I 



is paracompact and normal, but / x / is neither [58 

15. MeASURABILITY and RANDOM VARIABLES IN D[0, 1] 

We equip C[0, 1], D[0, 1] and co(0, 1] with the cr-fields generated by point 
evaluations; we denote these by C (as in Section [TT]) . T> and Cq (to distinguish 
it from C). We further, as in Section [Til equip M[0, 1] with the a-field ^A 
generated by the mappings /x —>■ J/d/x, / e C[0, 1]. In the present section, 
we shall always use these cr-fields, even if we do not always say so explicitly. 

Note that C[0, 1] is a separable Banach space, and thus C equals the Borel 
cr-field 13(C) on C[0, 1]; moreover, it equals the cr-field S^(C) generated by 
the continuous linear functionals, see Corollary 111. 151 

On the other hand, -D[0, 1] is not separable, and T> is not equal to the 
Borel (T-field B{D), see Example 13.51 (The non-separability of D causes 
several problems, and is the main source of complications in the proofs 
below.) However, we shall see that T> equals the cr-field Bw{D) generated 
by the continuous linear functionals. It is also well-known that T> equals 
the Borel cr-field for the Skorohod topology on D[0, 1], see [fl. Section 12]. 
(This is a weaker topology which is separable metric but not a vector space 
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topology; it is the topology commonly used on D, but it is not used in 
the present paper where we consider Banach spaces.) Furthermore, V also 
equals the a- field generated by balls in D 0, Section 15]. 

Also co(0, 1] is not separable, but we have seen in Section [12] that it 
nevertheless has several nice properties. 

We begin by proving some lemmas. 

Lemma 15.1. The mappings {f,t) ^ f{t), if,t) ^ f{t~) o,'>T'd if,t) ^ 
Af{t) are measurable D x [0, 1] M. Furthermore, the map A is measurable 
D[0,l]^co{0,l]. 

Proof. Since each f e D is right-continuous, f{t) = lim„^oc f{\nt]/n), and 
(/, t) 1-^ f{\nt]/n) is measurable for each n. The measurability of f{t—) is 
shown similarly, using /(([nt] — l)/n) (for t > 0), and A/(i) = f{t) — f{t—). 

In particular, / i-^ A.f{t) is measurable for each fixed t, which shows that 
A : -D[0, 1] co(0, 1] is measurable. □ 

Lemma 15.2. There exists a sequence of measurable maps ■ i^[0, 1] 
[0,1], k = 1,2,..., such that if f e D[0,1], then the non-zero values of 
^k{f), = 1, 2, . . . are the jump points of f , i.e., the points x e [0, 1] with 
|A/(x)| > 0, without repetition. 

Proof. If / e D[0, 1] and / c [0, 1] is an interval, define 

var(/;I) := sup{|/(x) - : x, y e /}. (15.1) 

Note that it suffices to consider x,y in (115. Ih that are rational, or equal to 
the right endpoint of /; this implies that / ^ var(/;/) is measurable for 
each I. 

Fix e > and f & D and consider for each n the sequence . . . , of 

all dyadic rationals /i:/2" such that 1 ^ ^ 2" and var(/; [(A;-l)/2", A;/2"]) ^ 
e; we assume that this sequence is in increasing order and we extend it to 
an infinite sequence by defining x^"^ = for k > m{n). It is easily seen that, 

as n — > cx), x^"^ Xk for each k, where xi,X2, • • • are the points x where 
|A/(x)| ^ e, taken in increasing order and extended by O's to an infinite 
sequence. By construction, for each k, the maps / i— > x^"^ are measurable, 
and thus each measurable function of /. Repeating this construction 

for e = 2^™, m = 0, 1, 2, . . . , we may rearrange the resulting sequences in a 
single sequence {xijf , eliminating any repetitions of non-zero values. □ 

Remark 15.3. In Lemma 115.21 we may further assume that Xk{f) are 
arranged with |A/(xi)| ^ |A/(x2)| ^ . . . . We will not use this, and leave 
the proof (using Lemma Il5.ip to the reader. 

Lemma 15.4. The map (/, /i) ^ f dfi is measurable D[0, 1] x M[0, 1] 
R. 
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Proof. First note that the Riemann-Stieltjes sums 

Snif, /i) := 2 {i + l)/n) + f{l)fi{l} (15.2) 

i=0 

are measurable, and that, using the notation in (115. ip . 



Jo 



^ ll^ll maxvar(/; [i/n, {i + l)/n]). (15.3) 

i 

Define S*{f;fj.) := limsup^^or, S'„(/; /i). Then (jl5.3p implies 

^ ll^ll hmsupmaxvar(/; [i/n, {i + l)/n]) 



5* (/,/")- f/d^ 
Jo 



= ||/i|| max |A/(x)|. (15.4) 
xe[0,l] 

Let Xk{f) be as in Lemma [15. 21 and let be the (non-linear) measurable 
map D ~* D given by 

n 

VJix) := 2 A/(xfc(/))l{x ^ Xfc(/)}. (15.5) 

fc=i 

Thus max^. |A(/ - K/)(j;)| = maxfc>„ |A/(xfe(/))| as n ^ oo, since 
A/ e Co (0,1] by Theorem 113.11 and it follows from (jl5.4p that, for any 
/e L>[0, 1] and /xe M[0, 1], 

S*{f'Vnf;fi)'l\f'Vnf)dfi~>0, asn^c». (15.6) 
Jo 

Consequently, / d/i is the limit as n ^ oo of the measurable functions 

S*{f-Vnf;f^)+ K/d^ = 5*(/-K/;^)+ V A/(xfc(/))^[xfc(/),l], 

where the last factor is measurable by Lemma Fl 5 . 1 1 since fi ^ G^{t) := ^(t, 1] 
is measurable M[0, 1] ^ -^[0, 1] and ^\x, 1] = G^{x—) for x > 0. □ 

Theorem 15.5. Every continuous linear form x £ -D[0, 1]* is T) -measurable. 
Hence T> = Bw{D), and a D -valued random variable X is T> -measurable if 
and only if it is weakly measurable. 

Proof. By Lemma [15.41 / i-^ Jo /d/x is P-measurable for every e M[0, 1]. 
It follows from Corollary 113.21 that / i-^ (x, /) is D-measurable for every 
xe^[0,l]*. 

This implies Bw{D) ^ V. Conversely, each point evaluation f(t) = {6t, /) 
where 6t e ^[0, 1]*. Hence V = B.^{D). □ 

Remark 15.6. We can extend the map in Lemma 115.41 to (/, x) ^ {/> x) 
for / e D, X e D*; however, this map is not jointly measurable for D 
and the cr-field V* on D* generated by x ^ (X;/)) f ^ D. (The map is 
separably measurable by Theorem 115.51 ) In fact, let a{t) : [0, 1] ^ M be a 
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non-measurable function. Then the maps t ft := and t xt '■= 

g a{t)Ag{t) are measurable for D and D* , respectively; note that for 
any fixed g, t ^ (xt^9} = CL{t)^g{'t) is measurable since it has countable 
support. However, 1 1— > {ft,Xt} = is non-measurable. 

Remark 15.7. We have -D[0,1] = C{I), and it follows from Lemma Il5.ll 
that V also equals the cr-field generated by point evaluations on /. We can 
also consider the map (/, t) ^ f{t) for / e D[0, 1] and tel. However, 
in contrast to Lemma 115.11 this map is not jointly T> x ;B(I)-measurable, 
where B{I) is the Borel cr-field on I. To see this, let A cz [0, 1] be a non- 
measurable set (with e A) and let (/? : / ^ / be the function defined by 
:= u+ when u e A and ip{u) := u— when u ^ A; then 99 is increasing 
and thus Borel measurable. Furthermore, the function u ^ /„ := l[u,i] 

is a measurable map [0,1] —>■ D[0,l] = C(l). Hence, u ^ {fu,(p{u)) is 
measurable [0, 1] C{I) x I. However, the composition u ^ fu{(p{u)) = 
l^(ti) is non-measurable, showing that (/, t) 1-^ f{t) is not measurable on 
C{I) X /. 

One of the main purposes of this section is to prove the following theorem, 
extending Theorem 115.51 to multilinear forms. (Note that the corresponding 
result for C[0, 1] is immediate, since C equals the Borel cr-field on C[0, 1] and 
C[0, 1] is separable, which imply that the product cr-field C™' on (C[0, 1])™ 
equals the Borel cr-field.) 

Theorem 15.8. Every bounded multilinear form T : {D[0, 1])"* M, for 
any m ^ 1, is T> -measurable. 

Proof. We shall prove the more general result that for any m,i ^ 0, any 
bounded multilinear form a : (-D[0, 1])™ x (co(0,l])^ ^ M is measurable. 
We do this by induction over m. 

First, assume that m = 0, so a : (co(0, 1])^ M. Recall the pro- 
jections Pa in 00(5") defined in (112. Ih and let A be a countable subset 
as in Lemma 112.21 (with S = (0, 1] and k = t). If A is finite, then 
a(PA/i) • • • 1 PAfe) is a finite linear combination of products of point evalu- 
ations, and thus measurable. 

If ^ is infinite, write A = {xi, X2, . . . } and define P„ := -P{xi,...,x„}- I^o^ ^'ny 
/ e co(0, 1], Pnf PAf in co(0, 1] as n ^ 00, and thus a(P„/i, . . . , Pnfi) 
a{PAfi, • • • , PAfe)- Each map a{Pnfi, . . . , Pnfe) is measurable, and the re- 
sult in the case m = follows by (jl2.2p . 

Now suppose that m ^ 1. Consider first the restriction oq of a to C x 
D'"-! X co(0, l]f For fixed f2,---,fm e D and gi,...,gi e co(0, 1], oq 
is a bounded linear functional on C[0, 1]; thus oq can be regarded as a 
multilinear map Tq : Z)™"^ x co(0, 1]^ C[0, 1]* = M[0, 1]. For a fixed 
/i e C[0,1], the map (/2, ...,/„, 51, 5^) ^ ao(/i, /2, • • • , /m, 5i, • • • , 5^) 
is measurable by induction, which by the definition of the cr-field M in 
M[0, 1] shows that Tq is measurable. 
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Define 

ai{fi,f2,---,fm,gi,---,ge) ■= fidTo{f2, . . . , f.m,9i, ■ ■ ■ ,g£)- (15.7) 

Jo 

Then ai is a bounded multilinear form (D[0,1])™' x (co(0, 1])^ M, and 
ai is measurable by Lemma 115.41 and the measurability of Tq. Moreover, if 
/i e C[0, 1], then ai(/i,/2, ■ ■ ■ , fm, 9i, ■ ■ ■ , ge) = Q!(/i,/2,. . ■,fm,gi,-- ■,ge)- 
Define 02 ■= a — oi. Then a2 = on C x D^^^ x co(0, 1]^, so 02 
can be regarded as a multilinear form on (D/C) x x co(0, 1]^. By 

Theorem 113.11 A : D/C co(0, 1] is an isomorphism, so there exists a 
bounded multilinear form 03 : co(0, 1] x D™^^ x co(0, 1]^ — > M such that 

a2{fi,f2,---,fm,gi,---,ge) = a3{Afi,f2,---,fm,gi,---,ge)- (15.8) 

Then as is measurable by induction, and since A : D ^ co(0, 1] is measur- 
able by Lemma ll5.ll (|15.8p shows that a2 is measurable. 

Thus, a = ai + 02 is measurable. □ 

Corollary 15.9. Let X be a D-measurable D[0, l]-valued random variable. 
Then X®^ is weakly measurable in D®^ and in D®^ for every k ^ 1. 

Proof. Immediate by Theorems 14.61 and 115.81 and the continuous map l : 
jj§)k _^ D®^ ^ □ 

We have seen in Example 13.51 that a P-measurable D-valued random 
variable X is not always a.s. separably valued. In fact, the following theorem 
describes the situation precisely: X is a.s. separably valued if and only if 
the jumps only occur in a fixed countable set. (Cf. Theorem 1 1 2 . 5 1 for 00(5*).) 

Lemma 15.10. A subset Dq <^ D is separable if and only if there exists a 
countable subset N of [0,1] such that supp(A/) := {t : \Af{t)\ 7^ 0} ^ iV 
for each f e Dq. 

Proof. If N ^ [0, 1] is countable, then 

Di := {/ e D[0, 1] : supp(A/) c AT} (15.9) 

is a separable subspace of D, for example because A induces an isomorphism 
Di/C = co{N), and both C and co{N) are separable. 

Conversely, ii Dq <^ D is separable and {fn}n^i is a countable dense 
subset, then := (J„ supp(A/„) is countable and supp(A/) ^ for every 
feDo. □ 

Theorem 15.11. Let X be a D-measurable D[0, l]-valued random variable. 
Then X is a.s. separably valued if and only if there exists a countable subset 
N of [0, 1] such that a.s. supp(AX) := {t : \ AX{t)\ 7^ 0} ^ iV. 

Proof. Immediate from Lemma 115.101 □ 

However, a weak version always holds. 
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Lemma 15.12. Let X be a T) -measurable Z)[0, l]-wa/uec? random variable. 
Then there is a countable set N a [0, 1] such that for each t e [0, 1]\-/V, 
AX{t) = a.s. 

The exceptional null set may depend on t, in contrast to the condition in 
Theorem 115.111 

Proof. By Theorem ll2.'^(ii)] applied to AX e co(0, 1], which is Cg-measurable 
by Lemma llS.li □ 

Theorem 15.13. Let X be a T) -measurable -D[0, \\-valued random variable. 
Then X is weakly a.s. separably valued. 

Proof. Let N be as in Lemma 115.121 and let Di <^ D he the separable 
subspace defined in (|15.9[) . 

Suppose that x ^ with x -L -Di, and represent x as in (113. 4p . Since 
X -i- Di and C ^ Di, we see that if / e C, then = xif) = Iq /d/x; thus 
/i = and xif) = Si for all f e D. Moreover, if t e A^, then 

l[i 1] e Di, and thus = = h{t). Hence, any x -L -Di has the form 

xif) = 2 h{t)Af{t) (15.10) 

teR4 

for some countable set M = {t : h{t) 0} with M n TV = 0. 

For each t e M, we have t ^ N and thus X[t) = a.s., and thus a.s. 
xiX) = by (fTCTI). □ 

We extend this to X®''. 

Theorem 15.14. Let X be a D-measurable D[0, l]-valued random variable. 
Then, for every k ^ 1, X®^ is weakly a.s. separably valued in the projective 
and injective tensor products {D[0, 1])®'^ and {D[0, 1])®*^. 

Proof. It suffices to consider the projective tensor product since l : {D[0, 1])®^ 
{D[0, 1])®'= is continuous. 

Let, again, N be as in Lemma 115.121 and let Di ^ D he the separable 
subspace (jl5.9p . Then Df'^ is a separable subspace of D®^. We claim that 

if X e (D®'^)* and x -L Df'', then x(-'^®'^) = a.s., which proves the lemma. 
By Theorem 14.61 x is a bounded fc-linear form on D. We will prove the 
claim by induction, using a more elaborate claim. 

For £,m ^ 0, let L^^m be the set of all (^ + m)-linear forms a e L{D^^"^, M) 
such that 



a(/i,---,/^+m) = if /i, ...,/£+„ e L>i, (15.11) 



and 



a(/i,---,^+m) =0 if /, e C for some i ^ £. (15.12) 
Claim, li i,m ^ 0, then a{X, . . . ,X) =0 a.s. for every a e Li^m- 
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The case £ = 0, m = k yields the claim = a.s. above, proving 

the lemma. We prove the claim by induction on m. 

Step 1: m = 0. If m = 0, then (|15.12p shows that a can be seen as 
an linear form on D/C = co(0, 1]. Hence there exists an ^-linear form 
/3:co(0,l]^^]R such that 



a(/i,...,/,) = /3(A/i,...,A/, 



By (jl5.1ip . (3{gi, . . . , gg) = if supp(7j ^ N for every i. Let A be a countable 
subset of (0, 1] given by Lemma 112.21 (applied to f3). Then, as in the proof 
of Theorem 112. ^riii) Pa{^X) = PAnNi^X) a.s., and thus a.s. 



aiX,...,X) = (3{AX,...,AX) = (3{PA{AX),...,PAiAX)) =0. 

Step 2: m ^ 1. Let k := I + m ^ 1. If A; = 1, then the result is 
Theorem 115.131 (and its proof). Thus assume k^ 2. 

For fixed /i, . . . , fk-i, the map fk ^ a(/i, • • • , fk) is a bounded linear 
form on D. The restriction to C gives an element of C* = M[0, 1], i.e. a 
signed measure IJ'fi,...j^_i on [0,1]. Define, similarly to (|15.7p . 



ai(/i,---,/fc) := f /fcd/i/,,.. 
Jo 

Then ai is a bounded fc-linear form on D, and thus so is 02 := a — ai. 

U h,...,fk-ie D, and /fc e C cz Di, then a(/i, . . . , A) = by (fmT]) ; 
hence fJ'fi,...j^._i = and thus ai(/i, . . . , fk) = for any e D. Similarly, 
by (jl5.12p . if /j e C for some i ^ i, then lJ'fx,...Jk-\ = ^"^^ "i(/i) • • • > fk) = 
0. Hence, (jlS.lip and (jl5.12p hold for ai, i.e., ai e L^.^. Consequently, 
02 = a — cti e L^^m too. 

Moreover, if e C, then the definition of ai yields ai{fi, . . . , fk) = 
a{fi,---,fk) and thus 

a2(/i,---,/fc) = a{fi,...,fk) - ai{fi, . . . , fk) = 0. 

Hence (|15.12p holds for i = k = I + m too, so (after relabelling) 02 £ 
-^^£+i,m-i! and by induction 02 (-'^, • • • > -'^) =0 a.s. 

Return to ai. For each fixed A e C, (/i, . . . , fk-i) ^ ajfi, ■ ■ ■ , fk-i, fk) 
defines a (fc — l)-linear form on D, which by (jl5.1ip - (|15.12p belongs to 
Lg^jji-i- By induction, thus a{X, . . . , X, fk) = a.s. for each fixed fk e 
C. By taking fk in a countable dense subset of C, it follows that a.s. 
a{X, . . . ,X, f) = for every f e C. Thus, a.s., fix,...,x = and ai{X, . . . ,X, f) 
for every f e D; in particular, ai{X, . . . ,X,X) =0. 

We have shown that a{X, ... ,X) = ai{X, . . . , X) + a2iX, . . . , X) = 
a.s. when a e which proves the claim. □ 

16. Moments of valued random variables 

After the preliminaries in the last sections, we can prove analogues of The- 
orem UlTMILSS] for D[0, 1]. (Note that although L>[0, 1] = C(/), we cannot 
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use these theorems in Section [TT] directly, since -D[0, 1] is non-separable and 
thus / is not metrizable.) 

We begin with describing the space D[0, 1]®^ where the moments live. 
By Theorem [IMI D[0, 1]®'' = Cil)®^ = Cil^). We return from / to [0,1] 
by taking the restrictions of the functions in C{I)^ to the (dense) subset 
[0, 1]*^ c (i.e., the normal points in I^). 

Definition 16.1. ^([0, 1]^) is the Banach space of all functions [0, 1] M 
that have a continuous extension to 7^; D([0, l]'^) is equipped with the 
supremum norm. Thus -D([0, 1]^) is naturally isometric to C{I^). 

This means that / e D{[0,lf) if at each (ti,...,tfc) e [0, l]'^', / has 
limits in the 2^ octants (with obvious modifications at the boundary). More 
precisely, taking k = 2 for notational convenience, / e D{[0, 1]^) if and only 
if, for each (s,t) e [0, 1]^, the limits 
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exist (as finite real numbers), except that we ignore all cases with an ar- 
gument 0—. Note the slight asymmetry; we use ^ but <. Note also that 
necessarily f[s+,t+) = f{s,t) when it exists. 

Theorem 16.2. If k ^ 2, then L»[0,1]®^ c Z)[0, 1]®^ = D{[0,lf). (The 
subspace D[0,1]®'^ of D {[0,1]'^) is not closed, and the norms are different 
and not equivalent on D[0, l]®'^.^ 

Proof The equality L>[0,1]®^ = D{[0,1]'') follows by Theorem [lL6] ap- 
plied to C(/), together with Definition 116. H and the inclusion Z)[0, l]®'^ c 
D[0, 1]^^ by Corollary dLll or by Corollary [I4l and Theorem EH 

The claim that D[0, 1]®'^ is not a closed subspace of -D([0, 1]^), is a special 
case of the general fact in Remark 111.91 applied to C{I), but we give also 
a direct proof, using an argument from Varopoulos [g^ (where C(T)®C(T) 
is studied, and more generally C{K)0C{K) for an abelian compact group 
K.) 

By the closed graph theorem the claim is equivalent to the claim that 
that the norm on D[0, 1]®^ is not equivalent to the norm inherited from 
D{[0, 1]*^), i.e., the sup norm. 
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It suffices to consider the case k = 2. If F e L^([0, 1]^), let F{m,n) := 
55F(s,t)e2'^^('^''+"*) dsdt be its Fourier coefficients. Since D[0, 1] cz L\0, 1], 
Parseval's identity and Holder's inequality imply, together wih ()4.4p . that 
if F e L>[0, then i;^=_oo n)| ^ \\F\\dio,i]§2- However, there ex- 
ist trigonometric polynomials f{t) = Xln such that supj/(t)| = 1 
with |a„| arbitrarily large. (For example Cesaro means of the Fourier 
series sin27rint/(nlogn), which represents a continuous function (toI . 
Section V.l].) Taking F{s,t) := f{s + t) e C{[0, if) we have \\F\\d{[o,i]2) = 
sup \F{s,t)\ = 1 and H-^H^jj-Q ^ 1]„ which is arbitrarily large. □ 

Example 16.3. Let W be standard Brownian motion, regarded as a random 
variable in D[0, 1]. Then all (projective and injective) moments exist (in 
Bochner sense), and are the same as for W regarded as an random variable 
in C[0, 1], see Example [11.111 and Remark [02l In particular, EW^®^ is the 
covariance function s a t regarded as an element of Z)[0, 1]®^ = -D([0, 1]^), 
and EIF®^ is the same function regarded as an element of the subspace 
D[0, 1]®^. Similarly, the fourth moment is given by the function ()11.4p . 

Example 16.4. The D[0, l]-valued random variable X = ^[u,i] in Examples 
13.51 and [5. 181 is not a.s. separably valued, see Example 15.181 and thus it has 
no moments in Bochner sense; however, all moments exist in Pettis sense by 
Theorem 116.101 below. The A;:th moment is given by the function 

^Xih) ■ ■ ■ X{tk)) =E1{U ^h,...,U ^tk} = mm{h, tk}. 

This function is continuous, and thus belongs to C([0, 1]^) D{[0,1]^). 

Note that the second moment is the same as for Brownian motion (Ex- 
ample [163]), but not the fourth (or any other moment). 

Example 16.5. For a simple example with a discontinuous function in 
D{[0, if) as second moment, let S„ = Yjj d be a simple random walk, with 
i.i.d. and F{^i = 1) = F{^i = -1) = i. Let X„(t) := 5^„tj/v^. Then 
the second moment of Xn e -D[0, 1] is the function in Z)([0, 1]^) given by 
E(X„(s)X„(t)) = [n{t A u)\/n. 

We turn to conditions for the existence of injective moments. 

Theorem 16.6. Suppose that X is a T> -measurable D\{),l\-valued random 
variable. Let k ^ 1. 

(i) EX®'^ exists in Dunford sense the weak k:th moment exists 
^ supte[o,i]E|X(t)|'= <oo. 

(ii) EX^^ exists in Pettis sense <^ the family {|X(t)|^ : t e [0,1]} of 
random variables is uniformly integrable. 

(iii) EX®'^ exists in Bochner sense E(supjg|-Q |X(t)|)^ < oo and 
there is a countable set N cz [0, 1] such that supp(AX) ^ N a.s. 
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// EX®'^ exists in Bochner or Pettis sense, then it is the function in 
D[Q, l]®'^ = Z)([0, l]'^) given by 

EX®'{ti,...,tk)=E{X{ti)---X{tk)), ti,...,tke[0,l]. (16.1) 

Proof. We use L'[0, 1] = C{I) and try to argue as in the proof of Theo- 
rem [ILTni however, several modifications are needed. 



The forward imphcations are immediate as in Theorem [TTTT61 but for 
the remaining imphcation we argue somewhat differently. 

Consider a linear form fj. e {D[0, 1]®"=)* = C{P)* = M,{P) with ^ 1. 
Then fj, can be regarded as an integral multihnear form on D[0, 1]*^; by 
Corollary 115. 9^ is measurable. 

A serious technical problem is that X(t,uj) is in general not jointly mea- 
surable on / X $7, see Remark 115. 7| hence we cannot use Fubini's theorem 
as in (lll.6|) and (lll.7p . We circumvent this as follows. Similarly to (Ill.Th . 



\(fi,X'^^)\ 



f X{ti)---X{tk)dfi{ti,...,tk) 

k 

^jX{t)\''du{t) (16.2) 



for some positive measure on I with H^^H^/^f) = ^ 1. We now regard 

as a continuous linear functional x on C{I) = D[0,1], and represent it by 
Corollary [m as / ^ /di^i + h{t)Af{t) with 

IIj^iIIm + ll^llfi ^ 2||i/||_D* ^ 2. (16.3) 

Thus, (fTO]) yields 

Km,X®^>|^ fVwi'di^i(i)+ 2 h{t)A\X\'^{t). (16.4) 

te(0,l] 

Since X[t, u) is jointly measurable on [0, 1] x 17 by Lemma [15. II and the sum 
in (jl6.4p is countable, we can take the expectation in ()16.4p and use Fubini's 
theorem here, obtaining 

E\(^,,X^'')\^ (\\X{t)\''d\u,\{t)+ 2 \h{t)\{E\X{tt + E\X{t-t). 
■^^ te{0,l] 

(16.5) 

Now suppose that supfg|-o^i] E|X(t)|^ ^ C. Then Fatou's lemma applied 
to a sequence t^ y t yields also E \X{t—)\'^ ^ C for every t > 0, and (jl6.5p 
implies 

E|<//,X®^>| ^ C\\ui\\m + 2C\\h\\ei ^ 4C. (16.6) 
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This shows that (^ix^X®^) is integrable for every /i e (D[0, 1]®'^)*, which 
shows that X®^ is Dunford integrable, completing the proof of (i) 



As in Theorem 111.161 the forward implication follows by Theo- 



rem EMi)l taking x* = 5t,te [0, 1]. 



For the converse, apply (116.60 to , where E e T \s wa. event, and 

obtain 

¥\lE{^i,X®^)\ ^ 4 sup E(l,5|X(t)|'=), (16.7) 

tG[0,l] 

which by ()5.4[) shows that if the family {|X(t)|'^} is uniformly integrable, then 
the family {{/i, X®^) : ||;u|| ^ 1} is uniformly integrable. Since Theorem [T5.14l 
shows that X^^ is weakly a.s. separably valued, it follows by Theorem 15.81 
that ¥.X®^ exists in Pettis sense. 

Immediate by Theorems 16.71 and 115.111 



ni, 



The final claim follows by Theorem 116.21 and the argument in the proof 
of Theorem lll.lOl which yields (|11.3p in the present setting too. □ 

The case A; = 1 in Theorem 116.61 gives the following characterisations of 
the existence of the expectation EX of a -D[0, l]-valued random variable. 

Corollary 16.7. Let X he a T) -measurable D[0, l\-valued random variable. 

(i) EX exists in Dunford sense sup^gj-g E |X(t)| < cx). 

(ii) EX exists in Pettis sense the family {X{t) : t e [0, 1]} of random 
variables is uniformly integrable. 

(iii) EX exists in Bochner sense E(supjg|-o i] |X(t)|) < c» and there 
is a countable set N cz [0, 1] such that supp(AX) <^ N a.s. 

In the Pettis and Bochner cases, EX e D[0, 1] is the function t ^ EX(t). 

□ 

As in Theorem 111.191 an even injective moment exists in Pettis sense if 
and only if it exists in Dunford sense and it belongs to D[0, l]®'^ = D{[0, if). 

Theorem 16.8. Suppose that X is a T> -measurable D[0, l]-ua/ued random 
variable such that S'VL^te[Q.i\ < Suppose that k ^ 2 is even. Then 

the following are equivalent. 

(i) EX®^ exists in Pettis sense. 

(ii) The function g{t) := EXitf belongs toD[0,l], and g{t-) := EX(t-)^, 
< t ^ 1. 



Proof, (i) =^ (ii) : If t„ is a sequence in [0,1] and t„ \ t, then X(t„ 



X{tY, while litn / t, then X{tnf ^ X(t-)*=. By Theorem[TMl {|^(t)r : 
t e [0,1]} is uniformly integrable; thus it follows that EX(t„)'' EX{tf 
or EX(t„)'= EX{t-f, respectively. 



(ii) =^ (i) If tn is any sequence in [0,1], there exist a subsequence 
(still denoted tn for convenience) such that tn ^ t for some t e [0, 1]; we 
may furthermore select the subsequence such that either tn ^ t or tn < t 
for all n. In the first case, X{tn) X{t) and thus \X{tn)\'' \X{t)\''] 
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furthermore, by (ii) and the fact that k is even, E|X(t„)|'^ = g{tr, 



g{t) = E\X{t)f. In the second case, similarly \X{tn)\ ^ and 
E|X(i„)|^ = g{tn) g{t-) = E|X(t-)|^. In both cases it follows that 
|X(t„)|^ converges in ^^(P) (to \X{t)\^ or see [H, Theorem 5.5.2]. 

Consequently, {\X{t)\'' : t e [0,1]} is a relatively compact subset of L^{P), 
and in particular relatively weakly compact and thus uniformly integrable 



23, Theorem IV.8.11]. Thus (i) follows by Theorem [Mi^ii)] □ 



The extra condition g{t—) := E,X{t—)^ in Theorem 116.81 cannot be omit- 
ted, as seen by the following example. 

Example 16.9. Let In := [1 - 2"", 1 - 2""-^) and let X equal 2''/'^li^ 
with probability 2"", n ^ 1. Then EX{t)^ = l[i/2,i)(t) ^ 1 but {X{tf} 

is not uniformly integrable; hence it follows from Theorem 116.61 that EX®^ 
exists in Dunford sense but not in Pettis sense. Note that g{t) := ¥,X{t)'^ = 
l[i/2,i)(i) e D[0, 1] but EX(l-)2 = ^ ^(1-). 

For projective moments, we do not know any general necessary and suf- 
ficient conditions for existence in Pettis or Dunford sense, but we have a 
simple sufficient condition. 

Theorem 16.10. Let X be a T> -measurable I?[0, l\-valued random variable, 
and suppose that E < oo. 

(i) Then E X®^ exists in Pettis sense. 

(ii) EX®'^ exists in Bochner sense there is a countable set N cz [0, 1] 
such that supp(AX) ^ a.s. 



Proof, (i) Let a e L(D*'',M) be a fe- linear form. Then {qjX®'^) is measur- 



able by Corollary 115. 9^ and 

,X®'')\ ^ WaUXf. 



It follows that the family {(a, X®'^') : ||a|| ^ l} is uniformly integrable. 
Moreover, X®^ is weakly a.s. separably valued by Theorem 115. 14[ Hence 
Theorem 15.81 shows, using Theorem IMl that EX®'= exists in Pettis sense. 



(ii) This is another special case of Theorem 16.71 □ 



For the second moment, we can as for C{K) use Grothendieck's theorem 
Theorem 111.201 to show that the conditions for the injective moment in 
Theorem 116.61 also imply the existence of the projective second moment, 
thus improving Theorem 116.101 when k = 2. Example 111.271 shows that this 
does not extend to /c ^ 3. 

Theorem 16.11. Let X be a D-measurable D[0, l]-valued random variable. 

(i) EX®^ exists in Dunford sense EX®^ exists in Dunford sense 

the weak second moment exists sup^gp^i] E |X(t)p < cxd. 
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(ii) EX®^ exists in Pettis sense EX®^ exists in Pettis sense 

the family {\X{t)\'^ : t e [0,1]} of random variables is uniformly inte- 
grable. 

(iii) EX®^ exists in Bochner sense EX®^ exists in Bochner sense 

E(supjg|-o 1] |X(t)|) < 00 and there is a countable set N cz [0, 1] 
such that supp(AX) c= X a.s. 

Proof. The forward implications follow directly, as in the proof of Theo- 
rem [TL221 using also Theorem [T5TTTJ 

(i) Let a be a bounded bilinear form on Z)[0, 1] = C{I). By The- 
orem [TL2Q1 a extends to a bounded bilinear form on L?'(l,v) for some 
probability measure v on /; more precisely, (jll.lO|) yields 

|<a,X®2>| ^ 2A;G||a|| JjX(t)|2dr/(t). 

This is, apart from a constant, the same estimate as (|16.2p (proved for 
integral forms), and the same argument as in the proof of Theorem 116.61 
yields, cf. (fTHTH]) . 

E|<a,X®2>| ^ 8A;G||a|| supE|X(t)p. (16.9) 
te[0,l] 

Furthermore, {a, X®^) is measurable by Corollary I15.9[ It follows that if 
suPfg[o,i] IE|X(f)p < c», then EX®^ exists in Dunford sense. 

(ii) : Assume that the family {|X(i)p : t e K} is uniformly integrable. By 



(16.. 



applying ()16.9p to 1 £'X as in the proof of Theorem 116.61 we obtain from 
(1S31) that the family {a(X,X) : a e L(i:>[0, 1]^; M), ||a|| ^ l} is uniformly 

integrable. Moreover, X®^ is weakly a.s. separably valued by Theorem ll5.14l 
Hence Theorem 15.81 shows, using Theorem iJl that EX®^ exists in Pettis 
sense. 

□ 



(iii) This is again a special case of Theorem [6 



Theorem 16.12. Let X and Y be V -measurable D\{},l\-valued random 



varia 



bles such that sup^gp^ij |X(t)|^ 



< 00 



and sup^gj-Q 1] |y(t)| < oo. Then 



the following are equivalent. 

(i) Ea(X, X) = Ka(Y,Y) for every bounded bilinear form a on D[0,1]. 

(ii) E{xl{X)x^{X)) =E{x'^{Y)x^{Y)), for any x^, x| e L>[0, 1]* . 

(iii) E{X{ti)X{t2)) = E(y(ti)y(t2)) for any tiM e [0, 1]. 

(iv) EX®^ = Ey®^ in D[0, 1]®^, with the moments existing in Dunford 
sense. 

(v) EX®^ = Ey®^ in -D[0, 1]®^, with the moments existing in Dunford 
sense. 



Proof. We argue as in the proof of Theorem lll.23l with some changes. The 



show that (iii) 



implications (i) =^ (ii) =^ (iii) and (iv) 



(iv) is Corollary 16.171 and (v) 



(v) are trivial, the equivalence 
(ii) follows by (16. 3p . It remains to 
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Thus, let a e L{D[Q,lf;M) = L{C(lf;M). By Theorem dOO] there 
exists a probabihty measure v on I such that a extends to L'^(I,u). The 
main difference from Theorem 1 1 1 . 23 1 is that we cannot assert that X{t,Ljj) is 
jointly measurable on / x 0, see Remark ll5.71 It is, however, still possible to 
regard X as a map into v). We prefer to state this slightly differently, 
returning to [0,1] by the argument already used in the proof of Theorem 1 16. 61 
We thus regard v as a. continuous linear functional x on C{I) = -D[0, 1]; we 
now use the representation (jl3.7p in Remark 113.31 and write it as 

[/dz^ = x(/)= f /(t)d/ii(t)+ r/(t-)d^2(t), (16.10) 
JI Jo Jo 

where ^2 is a discrete measure supported on a countable set {tnYn=i- is 
easily seen that both and ^2 are positive measures. (We may alternatively 
omit this verification and replace them by and \^2\-, possibly increasing 

V.) 

Let S := [0, 1] u a I. We define a a-field A onT^hy A := {A ^ 

S : [0, 1] 6 0([0, 1])}, and let /i be the measure /ii + ^'2 on {Yi,A), where 
^2 is the measure on {tn—]n=i given by ^^{tn—} '■= ^J'2{tn}■ Then (116. lOp 
can be written 

J^/di^ = £/d/i. (16.11) 

Applying this to we see that ||/||^2(f^^) = II/IIl2(2_^) for all / e /^[0, 1], 
and a thus extends to a bounded bilinear form on L^(T,,fi). Moreover, 
Lemma 1 15. II implies that X{t,uj) is jointly measurable on S x fi. Conse- 
quently, X is a Bochner measurable random variable in iv^(E, n) by Lemma [10. 11 
Furthermore, the assumption that sup^E|X(t)p < 00 implies by Fubini's 
theorem, as in (I11.12p . that E ||X||^2(2 ;_t) < ^1 thus EX®^ exists in 

L^(i;,/x)®^ in Bochner sense. The same holds for EY®^. 

The proof is now completed as for Theorem 111.231 mutatis mutandis. □ 

Theorem 16.13. Let X and Y be T> -measurable D[0, l]-?;a/ued random 
variables, and suppose that either 

(i) E \\X\\^ < 00 and E ||y ||''' < 00, or 

(ii) k = 2 and sup{E|X(t)|2 : t e [0,1]} < 00, sup{E|y(t)|2 : t e [0,1]} < 
00. 

Then ()1.2p is equivalent to (jl.3p . and further to 

E(X(ti)---X(tfc)) =E(y(ti)---y(t,.)), ti,...,tfce[0,l]. (16.12) 



Proof. [(1)1 By Theorem [HIOl E and EF®*^ exist in Pettis sense. Thus, 



EX®^ and EY®^ too exist in Pettis sense, and the result follows by The- 
orem 18. 3[ Corollaries 16.171 and 16.141 and (jl6.ip , similarly as in the proofs of 
Theorems 11.11 and 11.31 



(ii) A simplified version of Theorem 116.121 □ 
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Remark 16.14. As for Theorem 111.231 we do not know whether the con- 



dition (i) can be weakened for k ^ 3. 



17. Uniqueness 

In the previous sections we have considered the k:th moment(s) for a fixed 
k. In this section and the next, we consider the sequence of all moments. In 
the present section we show that there are analogues of the classical results 
for real-valued random variables that the moments (under certain condi- 
tions) determine the distribution. In Section [18] we consider convergence, 
where the situation is more complicated and less satisfactory. 

We suppose for simplicity that the Banach space B is separable. All ran- 
dom variables are tacitly assumed to be (Borel) measurable, cf. Theorem l3.31 

We begin with two simple results on the existence of all moments. 

Theorem 17.1. Let X be a B-valued random variable, where B is a sepa- 
rable Banach space. Then the following are equivalent. 

(i) E < 00 for every k ^ 1, 

(ii) The projective moment EX®'^ exists in Bochner sense for every k ^ 1. 

(iii) The injective moment E exists in Bochner sense for every k ^ 1. 

Proof. An immediate consequence of Theorem 16.71 □ 

We do not know any general weaker criterion for the existence of projective 
moments in Pettis or Dunford sense. (See Theorem 19. 141 for one case where 
no weaker criterion exists, and Theorem 111.221 for when it does.) For 

injective moments we have the following. 

Theorem 17.2. Let X be a B-valued random variable, where B is a sepa- 
rable Banach space. Then the following are equivalent. 

(i) E\{x*,X}\^ < 00 for every k^l, 

(ii) The injective moment E X®^ exists in Dunford sense for every k ^ 1. 

(iii) The injective moment EX®^ exists in Pettis sense for every k ^ I. 



Proof. 



(ii) 



(ii) By Theorem 16. lC((ir)|[a) 



(iii) I If p)] holds, then sup{E |<x*, X>|'= 



^ 1} < 00 for 

every k ^ 1 by Theoreni El^i)] Thus sup{E |<x*, X>|''+1 : ^ 1} < oo, 
which implies that {|{x*,Ar)p: ||x*|| ^ 1} is uniformly integrable. Theo- 
rem [6Tn|ii||ay shows that (iii) holds. The converse is obvious. □ 



It is well-known that already on M, there are random variables with the 
same moments but different distributions, see e.g. 3J, Section 4.10]. A 
well-known sufficient condition for the distribution of X^ to be uniquely de- 
termined by the moments is the Carleman condition 



|;(E|x 



00. 



(17.1) 



n=l 



Note that (|17.ip is satisfied whenever Ee*'"^' < oo for some t > 0. 
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Theorem 17.3. Let B he a separable Banach space and let X and Y he two 

B -valued random variahles. Suppose that KWXW^ < go and E < oo for 
every k ^ 1 and that \\X\\ satisfies the Carleman condition (llT.ip . Then the 
following are equivalent. 

(i) X = Y. 

(ii) EX®'^' = Ey®'^' for every k ^ 1. 

(iii) EX®'= = Ey®'^' for every k ^ 1. 

(iv) (x*,X} = (x*,Y) for every x* e B* . 



Proof. Note that the moments exist in Bochner sense by Theorem 117.11 

follows by Theorem! 



(ii) 


is 




(iv) 



If X* e B* 

k 



then 

E<x*,x/ = <Ex®^ (x*)®'=> = <Ey®^ ^ 

Since E|<x*,X>|*= 



m 



E<x*,y>'' 

'^EIIXP, 



the 



for every A; ^ 1 by (|6.3p and 
Carleman condition (jl7.ip holds for {x*,X) too, and it follows that (iv 
holds. 

(iv) =^ (i) This is well-known (Sketch of proof: Any finite linear 
combination of elements of i?* is another element of B 
by the Cramer-Wold device, that 
of functionals x*. A standard application of the monotone class theorem 
shows that P(X e ^) = F{Y e A) for every Ae = B.) □ 



Hence (iv) implies 



holds jointly for any finite number 



Remark 17.4. The proof of Theorem 117.31 shows that it suffices that the 
Carleman condition holds for each (x*,X). Moreover, if we only consider 
injective moments, and the equivalences (i) (iii) (iv) then the mo- 



< 



ment assumptions may be weakened to E |{x*, X)| < cc and E |{x*, y)| 
00 for every k ^ 1, with the injective moments existing in Pettis sense by 
Theorem 117.21 

Remark 17.5. The assumption that B is separable is essential; the equiv- 
alence (i) (iv) is not true in general for non-separable B. Example 17.41 
gives an X in W\0, 1] such that <x*, AT) = a.s. for every x* e £^[0, 1]* = 



£2 [0,1], and thus (x*,X) 



<x*, y> with y = 0, ahhough X a.s. 
18. Convergence 



As in the preceding section, we assume that the Banach space B is sepa- 
rable, and that all random variables are (Borel) measurable. 

We consider a sequence X„, n ^ 1 of -B- valued random variables, and 
a potential limit X. For definition and general properties of convergence 

in distribution, denoted A„ — ^ X, see 0]. In particular, recall that con- 
vergence in distribution can be described by a metric, at least when B is 
separable as here, see @, Theorem 6.8]. (The non-separable case is more 
complicated and related to the existence of real-measurable cardinals, cf. 
Remark 19.131 see j^. Appendix III].) 
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As in the real-valued case, convergence in distribution implies conver- 
gence of the moments, provided some suitable integrability condition holds 
uniformly. We state one simple such result. 

Theorem 18.1. Suppose that X and X„, n ^ 1, are B-valued random 
variables, where B is a separable Banach space. Suppose that Xn — ^ X, 
and that sup„E < oo for every k^l. Then KXf'' EX^'' in B®^ 

andEX'^^ EX'^^ in B®^ as n ^ oo, for every k ^ 1. 

Proof. By Theorem II 7. H all moments E X®^ and E X®*^ exist. Furthermore, 
Xn\\ — — >■ ll^ll, and thus by Fatou's lemma (for convergence in distribution 



M, Theorem 5.5.8]), E||X||'^ ^ liminf„^ooE ||Xn|l'' < oo. Hence all mo- 
ments EX®'' and EX®'' also exist. 

By the Skorohod representation theorem 0, Theorem 6.7], we may assume 
that Xn X. Then X®'' X®'', since the (non-linear) mapping x ^ 
X®'' is continuous B B®''. Thus, \\X®'' - X®''\\ ^ 0. Furthermore, 

||^|)fc _ ^<g)fc|| ^ ||^|)fc|| ^ ^ ^ (-^g_^) 

and since sup„E||X„p'' < co and E||X||*'' < c», it follows that the family 
{IjX®'^ — X®''\\ : n ^ 1} is uniformly integrable (for any fixed k), see e.g. (s^ . 
Theorems 5.4.2-4.6]; hence E ||X®'= - X®''\\ 0. Consequently, 

WEX®'' - EX®''\\ = \\E{X®'' - X®'')\\ ^E\\X®'' -X®''\\ ^0, 

as n^oo. This proves EXf*= -> EX®'', and EX®'' EX®'' follows 
similarly, or by Theorem 16.21 □ 

If B is finite-dimensional, then the converse to Theorem 118.11 holds, pro- 
vided the moments determine the distribution of X (for example by the 
Theorem 117. 3p ; this is the standard method of moments (in several vari- 
ables) . 

In infinite dimensions, there is in general no converse. We begin with 
a simple example showing that convergence of the injective moments does 
not imply convergence in distribution. Moreover, the example shows that 
convergence of the injective moments does not imply convergence of the 
projective moments. (The converse implication is trivial by Theorem] 



Example 18.2. Regard as a subspace of i'^ by the isometric embedding 
(ai,...,a„) ^ (ai,...,a„,0,0,...). Let X„ := n^^/^Ci, ■ ■ ■ ^ ^ (\ 
where Ci, • • • ~ -^(0, 1) are i.i.d. standard normal random variables. 

Note first that ||X„p = ^ Xir=i ~* ^ ^-^^ as n ^ 00 by the law of large 
numbers. Thus Xn does not tend to in distribution. 

Next, consider the injective moment EX®'^. (It does not matter whether 
we regard EX®'' as an element of (M")®'' or {l'^)®'', since (M")®'' is isomet- 
rically a subspace of {l'^)®'', see Remark lOl ) 
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If y = (ai,...,afc) e M", then {y,X} = Xij"=i '^i"-^^''^'^* is normal with 
mean and variance ^^^lafn^^K^f = ||yp/n, i.e. {y,X} ~ N{0, ||yp/n). 
Hence, for any yi, . . . ,yk e M", by Holder's inequality, 

|<EXf^yl(x)...(x)yfe>| = \E{(X,y,} ■ ■ ■ (X,yk})\ 

k II II 

^n(Ei<x,y,>iY/'^c,nM 

for some constant '■= E l^il'^. Since B^'^ can be seen (isometrically) as a 
subspace of L(i3'^;M), see Section HI it follows that 

||EX|"=|| ^ Cfcn-'^/^. (18.2) 

In particular, the injective moments KX^^ — > as n ^ c» for every k ^ 1. 
Finally, the second moment E X^'^ is given by the covariance matrix, 

EXf^ = (-E^i^j)\ ^ =-I, (18.3) 



where / is the identity matrix. Regarded as an operator, / is the identity 
operator in M", which has trace norm ||/||Ar(R") = n. Since the projective 
tensor norm equals the trace norm (for Hilbert spaces) , see Theorem 19.21 we 
obtain || EX®^|| = \\yJ\\j\f(Rn^ = 1. (Since there exists a projection M" 
of norm 1, it does not matter whether we regard EX®^ as an element of 
(M")®2 or (^2)®2.) Hence the projective moments EX®^ do not tend to 0. 



In fact, this extends to every infinite-dimensional Banach space. 

Theorem 18.3. Let B he any infinite- dimensional Banach space. Then 
there exists a sequence of Bochner measurable random variables X„ in B 
such that the injective moments E X®^ ^0 as n ^ cc for every k ^ 1 but 
Xn does not tend to 0; in fact, \\Xn\\ — ^ 1. 

Proof. Let £n (for example, := l/^^-)- By Dvoretzky's theorem, see 
3-g- [4^ or 53], for every n, there is a n-dimensional subspace Bn of B 



such that Bn is isomorphic to by an isomorphism r„ : Bn with 

l|r„||,||r-i|| ^i + sn. 

Let e be as X„ in Example HH^l and let X„ := r„X; e B. □ 

Remark 18.4. It is easy to see that we may replace Xn in Example 118.21 or 
Theorem [1831 by Xn/\\Xn\\, thus obtaining ||X„|| = 1 a.s. and EX®*^ for 
every k ^ 1. (In Example 118. 2|, this means taking Xn uniformly distributed 
on the unit sphere of M".) 

For projective moments, the situation is more complicated. We next 
give another example (with B = cq), showing that also convergence of the 
projective moments does not imply convergence in distribution in general. 
On the other hand, we then show that in a Hilbert space, it does (assuming 
a Carleman condition). Moreover, we shall show that in a Hilbert space. 
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even weak convergence (denoted — ^) of the projective moments suffices to 
imply convergence in distribution. 

Example 18.5. Let B = cq and let Xn be the B-vsdued random variable 
given by P(X„ = Cj) = 1/n, i = 1, . . . , n. Then \\Xn\\ = 1. 

If a is a /c-linear form on cq, then by ()12.4p . using the notation (112.30 and 
the Cauchy-Schwarz inequality, 



|<a,EX®'=>| = \ E(a,X^'') 



1 

- Va(ei,...,ei) 

T7. 



n . 

1=1 



n 

/ i - 

< 



-^\a{i,...,i)\ j 

1=1 



^(^2 |a(.i,...,.,)p)'^'^n-V2||«|| 

si,...,SfcGN 



Hence, using Theorem 14.61 

llxf^'ll ^ n"i/2 ^ asn->c». 

Consequently, E X®'^ for every k, but X„ 4^ 0. 

Theorem 18.6. Suppose that X and Xn, n ^ 1, are H-valued random 
variables, where H is a separable Hilbert space. Suppose further that \X\ 
satisfies the Carleman condition (fTTJ^ . // EXf'^ ^ EX®'' in B^^ for 
every k ^ 1, with the moments existing in Pettis sense, then Xn ——>■ X. 

Proof. For any fixed y e H, and any m ^ 1, 

2m 

- yP™ = (x-y,x- yy = Yj otk{x, • • • 

fc=0 

where is some bounded /c-linear form (depending on y and m). Hence, if 
jE ^ EX®^ for every k, then 

2m 2m 

EllX„-y||2™= 2E<afc,^n= 2<"^''IE^f'> 

fc=0 fe=0 
2m 

^ 2<afc,EX®*^> = E||X -yp"^. (18.4) 

fc=0 

Since ||X|| satisfies the Carleman condition, it is straightforward to show 
that ||X — y\ ^ ||X|| + llyll does too. It thus follows from p8.4p . by the 
method of moments, that 

\\Xn-yf ^\\X-yf. (18.5) 

(We use here the fact that for positive random variables, the Carleman 
condition can be relaxed to (|17.ip for the square root, see [s^, (4.10.2)]. 
Alternatively, we can introduce random signs and apply the method of mo- 
ments to show that — y|| — ^ — y||, where all odd moments vanish 
and thus converge trivially.) 
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The argument extends to any linear combination of — yi p, . . . , \\Xn — 
y^P for any given yi, . . . ,y£ e H; hence (118.5P holds with joint convergence 
for any finite set yi, . . . ,ye e H. 

Consequently, if yl ^ i? is a finite intersection of open balls B[yi,ri) := 
{x : \\x - yi\\ < rj such that F{X 6 dB{yi,ri)) = 0, then P(X„ e A) ^ 

F{X e A); this implies Xn X hy [1, Theorem 2.4]. □ 

Remark 18.7. The argument extends to the spaces (assumed to be 

separable) provided p is an even integer (and ||Xp/^ satisfies the Carleman 
condition). We do not know whether there are further Banach spaces such 

that E X^^ —>■ E X®'^ for every k implies Xn -—>■ X (provided X is bounded, 
say, for simplicity). 

Specialising to X = 0, we have the related problem: For which Banach 
spaces B does E X^^ — > in B'^'^ for every k imply X^ — 0? 

Next we show that weak convergence of the injective moments is equiva- 
lent to weak convergence in distribution, meaning convergence in distribution 
of {x*,Xn) for every x* e B*. 

Theorem 18.8. Suppose that X and Xn, n ^ 1, are B-valued random 
variables, where B is a separable Banach space. Suppose further that 

supE|<x*,X„>|'= < c» (18.6) 

for every X* e B* and every k ^ 1, and that every (^x* , X} , x* e B* , satisfies 
the Carleman condition (117. ip . Then the following are equivalent. 

(i) EXf'^ ^ EX®'^ in B®^ for every k^l. 

(ii) E{xl{Xn) ■ ■ ■ xliXn)) E{xl{X) ■ ■ ■ xl{X)) for every k ^ 1 and 
X*, . . . ,x^ e B* . (In other words, the weak moments converge point- 
wise.) 

(iii) E(x*(X„)'=) E(x*(X)'=) for every k ^ 1 and x* e B* . 

(iv) x*{Xn) x*{X) for every x* e B*. 

(v) x*{Xn) 2;*(X) jointly for all x* e B* . 

Note that all (injective) moments exist in Pettis sense by Theorem 117.21 
together with ()18.6p and the Carleman condition for {x*,Xy (which implies 
that E\(x*,X}\^ < 00 for every k). 

Proof. By assumption, for every k ^ 1, T : x* ^ {{x* , Xi),{x* , X2), ■ ■ ■) 
maps B* into ^°°(L'^(P)). By the closed graph theorem, T is bounded, and 
thus 

Ck := sup{E|<2;*,X„>|^' : ||x* || ^ 1, n ^ 1} < 00. (18.7) 
Note that, by definition, | (i) | holds if and only if 

(X, E > = E<x, •> - E<x, X®'^) = <x, E X®'^) (18.8) 

for every x £ [B'^^)* and every k ^ 1. 
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Choosing x = a;* (x) • • • (x) in ([ISSD , [(ii)] follows by 
■ (i) : Let X £ (-B®'^)*. By Theorem 14.71 x has a representation 
()4.10p . and as shown in the proof of Theorem 16.101 ()6.5p holds, together 
with the corresponding formula with X replaced by X^- Thus, (118.80 can 
be written 



f E(xt(X„ 



xl{Xn)) dfi{xl,. . . ,xl] 



f E{xt{X)---xl{X))dfi{xt,...,xl). (18.9) 
jk'' 



The integrand converges pointwise by 



ity and (UMl), |E(xJ(X„ 



furthermore, by Holder's inequal- 
^ Cfc. Consequently, (|18.9|) holds by 



dominated convergence. 

A special case, obtained by taking xf 
A standard polarisation argument. 



m, 



(iii; 



Given x*, 



use 



(iii) with X* := tix* + • • • + tkxf., where ti, . . . ,tk are real numbers. Then 
both sides of (iii) are (homogeneous) polynomials in ti, . . . ,tk, and since the 

the coefficient of ti • • • tfc 



left side converges to the right for every ti 



converges too, which yields (ii) (after dividing by k\). 

(iii) =^ (iv) : This is the usual method of moments for the real-valued 
random variables using the Carleman condition. 

(iv) =^ (iii) : For any fixed k, the random variables {x* 
formly integrable, by ()18.6p with k + 1. Hence (iv) 



(iv) 



(v) 



convergence for any finite set x* 



The joint convergence in (v) 
,xte B 





(iii) 





, are uni- 



means, by definition, joint 
Since any linear combination 



of X*, 



is another element of B*, this follows from (iv) by the Cramer 



Wold device. (Cf. the proof of Theorem 117.31 ) 



□ 



Remark 18.9. If all (injective) moments exist in Pettis sense and Theo- 
rem I18.^l fi)| holds, then 



m 



holds by (|6.3p . see the proof above, and thus 
(jl8.6p holds for every even k, and thus for every k, so (jl8.6p is redundant 
in this case. 

Example 18.10. Take B = f and let X„ be as in Theorem 118.31 and 
Remark 118.41 Then the injective moments KX^^ 0, and Theorem 118.81 
shows that <(x*,X„) -—>■ as n —>■ co for every x* e {i^)*; equivalently, 
{x* ,Xn) — ^ as n — > 00. However, ||X„|| = 1 and thus Xn 0. 

By Schur's theorem [l^, p. 85], a sequence in converges weakly if and 
only if it converges strongly (i.e., in norm). We see that this does not extend 
to convergence in probability (or distribution) for sequences of random vari- 
ables in i^. This also shows that Skorohod's representation theorem does 
not hold for weak convergence in distribution: there is no way to couple 
the random variables X„ such that X„ — ^ a.s., since this would imply 



Xn a.s. by Schur's theorem, and thus Xn 



0. 
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If we know tightness by other means, weak convergence in distribution is 
equivalent to convergence in distribution. 

Corollary 18.11. Suppose that X and X^, n ^ 1, are B-valued random 
variables, where B is a separable Banach space. Suppose further that all 
infective moments EX®'^ exist in Pettis sense, that EX®^ — ^ EX®^ in 
Q®k j-Q^ every k ^ I, that the sequence X„ is tight, and that every {x*,Xy, 
X* e B* , satisfies the Carleman condition (jlT.ip . Then X„ — ^ X. 

Proof. By Theorem 118.81 and Remark [18.91 x*(X„) x*[X) for every 
X* e B* . Since X„ is tight, every subsequence has a subsubsequence that 
converges in distribution to some random variable Y m. B Q]. Then, along 

the subsubsequence, a;*(X„) x*{Y) for every x* e S*, and thus x*{Y) = 

j;*(X), which implies Y = X, see Theorem 117.31 Hence every subsequence 
has a subsubsequence converging (in distribution) to X, which implies that 
the full sequence converges. □ 



In Hilbert spaces, we can use the second moment to deduce tightness. 
We regard as usual the second moments as operators on H; recall that 
they always are positive operators by Theorem 19. 4[ Recall also that if the 
second injective moment EX®^ exists (in any sense, e.g. Dunford) and is 
a trace class operator, then the projective moment EX®^ exists too, in 
Bochner (and thus Pettis) sense by Theorem 19.101 (And conversely, see 
Corollary 19.111 ) Moreover, the projective and injective second moments are 
then given by the same operator, so it does not matter which of them we 
use. 

We identify H0H with the space M{H) of nuclear (trace class) operators 
on H, see Section [9l For operators T,U m a Hilbert space H, we let as usual 
T ^ U mean (Tx, x) ^ (Ux, x) for every x e H; in particular, T ^ (T is 
positive) if (Tx, x) ^ 0. 

Theorem 18.12. Let H be a separable Hilbert space, and let {Xq, : a e A) 
be a family of H -valued random variables. Suppose that there is a nuclear 
operator T e H®H = M{H) such thatEX®^ ^ T for every a e A, with the 
moment existing in Dunford sense. Then {Xq, : a e A} is tight. 



Proof. By the spectral theorem for compact self-adjoint operators, e.g. [I3l . 
Corollary II. 5. 4], there exists an ON basis (e^) in H such that 

00 

r=2A„e„®e„, (18.10) 

n=l 

where A„ is the eigenvalue corresponding to e„, A„ ^ because T ^ E X®^ ^ 
0, and Xin=i ^ri = \\T\\j^i^H) < ^- 
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Choose a positive sequence Un —>■ co such that Xin=i '^n^n < oo, and define 

00 

IlkllP := 2 an\(X,en)\'^ ^ oo. 

n=l 

Define Kr := {x e -ff : |||x||| ^ r}. It is well known (and easy to see, e.g. 
using j43 . Lemma 2.2]) that each is a compact subset of H. Moreover, 
for each a, using (|6.3p and (jlS.lOp . 

00 00 

E|||X„|||2 = 2 a„E|<X„,e„>|2 = J] a„<Exf 2e„, e„> 

n=l ?i=l 

00 00 

n=l n=l 

Hence, by Markov's inequality, F{Xa ^ Kr) ^ Yin=i '^n^n/'''^ ^ as r ^ oo, 
uniformly in a e ^, which shows that {Xa} is tight. □ 

Theorem 18.13. Let H be a separable Hilbert space, and let {X^ : a e A} 

be a family of H -valued random variables. If the family {E X®^ : a e A} of 
projective second moments is relatively compact in H§)H = N{H), with the 
moments existing in Pettis sense, then {Xa : ae A) is tight. 

Proof. Consider any sequence (Xq,^)^^^ with On ^ A, n ^ 1. By the com- 
pactness assumption, there is a subsequence, which we simply denote by 
{Xn), such that EX§>^ ^ V in H®H = M{H) for some V e M[H). By 
taking a further subsequence, we may assume that 

||Ex|2-y||^(^) <2-". (18.11) 

Let Tn := EX®^ — V; this is a symmetric nuclear operator and the corre- 
sponding positive operator |T„| := (T*T„)^/^ satisfies 

II l^nj \\Af{H) = \\Tn\\Af{H) < 2^*^. (18.12) 

Define T := V + Xi^=i ^ ■^i^)^ where the sum converges in M{H) by 
(|18.12p . Note that for any x e iJ, 

<E Xf'^x, x) = (TnX, x) + (Vx, x) ^ <|r„|x, x) + {Vx, x) ^ <rx, x). 

Thus, EX®^ ^ T. By Theorem 118. 121 the sequence [Xn) is tight, and thus 
there is a subsequence that converges in distribution. 

We have shown that every sequence [Xa^) has a subsequence that con- 
verges in distribution; this shows that {Xa] is tight. □ 

This leads to the following convergence criterion, combining the second 
projective and arbitrary injective (or, equivalently, weak) moments. Com- 
pare Theorems 118.31 and 118. 6[ 
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Theorem 18.14. Suppose that X and X„, n ^ 1, are H-valued random 
variables, where H is a separable Hilbert space. If EX®^ EX®^ in 
i/®2 _ EXf'' ^ EX^'' in H®^ for every k ^ 1, with all 

moments existing in Pettis sense, and furthermore every (jj, X), y e H , 
satisfies the Carleman condition (jl7.ip . then X„ — ^ X. 

Proof. Since the sequence E X®-^ converges, it is relatively compact, and thus 
Theorem 118.131 shows that the sequence (X„) is tight. The result follows 
from Corollarv 118.111 □ 

We do not know whether there are similar results for other Banach spaces. 
Example 118.51 shows that convergence of moments is not enough to pro- 
vide tightness in general. Note that a commonly used sufficient condition 
for tightness of a family {X^} in C[0, 1], assuming {Xq(0)} tight, is that 
E(X(,(s) - Xa{t)f ^ C\s - t\^ for some C < oo, /? > 1 (typically, /3 = 2) 
and all s,t e [0,1]. (See [5, Theorem 12.3 and (12.51)] for a more general 
result, and [B^, Theorem 15.6] for a similar result for D[0, 1].) By expanding 
the fourth power and using (jll.2p . this can be seen as a continuity condi- 
tion on the fourth moments EX®^ e C([0, 1]^). This suggests that also for 
other spaces, it might be possible to find tightness criteria using suitable 
subspaces of B^^ or B®^ . We have, however, not explored this further. 

Appendix A. The reproducing Hilbert space 

In this appendix (partly based on [i^, Chapter 8] ) we study a construction 
closely related to the injective second moment, and explore the connection. 
We suppose that X is weakly measurable and furthermore that x*(X) e 
L^(P) for every x* e S*; this is by Lemma 16.81 equivalent to the existence 
of the weak second moment E(x*(X)x2(X)), e S*. Furthermore, 

this holds whenever the injective second moment EX®^ exists in Dunford 
sense, and the converse holds under weak conditions, for example when B 
is separable, see Theorem 16.101 

By Remark Em then Tx : B* ^ L^{F) and : L^{F) B**, and thus 
the composition T^T-^ : B* B** . This operator is characterised by 

<rlr^x*,y*> = (Txx^Txy''} = E(x*(X)y*(X)) . (A.l) 

In other words, T^Tj^ : B* B** is the operator corresponding to the 
weak moment, seen as a bilinear form B* x B* -^M. 
By dSl]), ([53]) and Remark EUl or by and fOll . 

T^TxX* =E{x*{X)X), (A.2) 

with the expectation existing in Dunford sense. 

Lemma A.l. Suppose that x*(X) e L^(P) for all x* e B* . Then the 
following are equivalent. 

(i) X is Pettis integrable, i.e., EX exists in Pettis sense. 
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(ii) 
(iii) 



: L2(P) . 



111 



B. 
B. 



Proof, (i) 



111 



ri(im(T^)) 
B. 



By Remarks 15.31 and I5.11[ 
Trivial. 

holds, then T^- maps im(r^) 



(ii): If 



111 



into B, 



B. Since \m{T^) 



ker(TJ), it follows that 



and thus 
L2(P) ^ 
□ 



By Remark 15.111 the assertions (i) (iii) in Lemma lA.ll hold whenever B 



is separable, and more generally when X is weakly a.s. separably valued. 

Recall from SectionlHthat B^B can be regarded as a subspace of L(B*; B). 
If the injective second moment EX®^ exists in Pettis sense, then by (j4.9p . 
(fOj) and (|A?T]) . EX®^ e B®B corresponds to the operator T^-T^. (In par- 
ticular, T^T-^ e L{B*,B) so X is Pettis integrable by Lemma lA.ll ) Hence 
T^Tj^ can be seen as a form of the injective second moment. 

Remark A. 2. Note that if, for example, B is separable, then T^Tj^ e 
L[B*,B) by Lemma lA.ll However, it does not always correspond to an 
element of B0B. For example, B = cq and X is as in Example 17.51 then 
EX®^ is the infinite diagonal matrix (p„a^(5mn)m n=i' ^^^^ corresponding 
operator T^T^ : Cq = £^ ^ cq is the multiplication operator {hn)f ^ 
n,ffl^6n)^. Choosing Un such that Pnoin — EX is thus the (infinite) 
identity matrix and T^T-^ is the inclusion map £^ ^ cq; in this case EX®^ 
exists in Dunford sense but not in Pettis sense by Example 17.51 and T^T-^ e 
L(co,co) but T^T^ ^ co(x)co. (Recall from Theorem 112.11 that co(x)co = 
co(N^), so the identity matrix is not an element of cq^cq.) 

Assume in the remainder of this appendix also that the assertions of 
Lemma [A. II hold. (Recall that this is the case for example if B is separable, 
or if EX®2 exists in Pettis sense.) Thus Tx : B"" ^ L'^{P), ?! : ^^(P) ^ B 
and T^T^ : B" ->■ B. Furthermore, im(r^)-L = ker(r|-) and thusim(r^) = 
ker(ri)^. 

induces an bijection of ker(rj)-^ onto im(r|-) ^ B. Let Hx be im(rj) 
equipped with the inner product induced by this bijection, i.e., 

(x,y}H^ := (Xnr'x, (Tl)-iy>i2(p) (A.S) 

where (T*)-^ : Hx ker{T*)-^ c L'^{F). Thus Hx is a Hilbert space 
isomorphic to ker(r|-)"'" and is a Hilbert space isomorphism im(T^) = 
ker(T|-)"'" — > Hx- Hx is called the reproducing kernel Hilbert space cor- 
responding to X Note that Hx ^ B with a continuous inclusion, 
since : ker(r|-)"'" ^ i? is continuous. Furthermore, im(T^) is dense in 
im(r^) = ker(r|-)-'-, and thus im(r|-T^) is dense in Hx- 
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The unit ball Kx of Hx is the image under of the unit ball of (P) . 
The latter unit ball is weakly compact, and since : L^(P) B \s contin- 
uous, and therefore weakly continuous, Kx is a weakly compact subset of 
B. In particular, Kx is closed in B. 

li X e Hx and x* B B* , then T|-T^x* e Hx and 

<rir^x*,x>^^^ =<T^x*,(ri)-ix> = <:E*,ri(ri)-ix> = <x*,x>. (a.4) 

Hence, the operator T^T-^ : B* — > i^x ^ is the adjoint of the inclusion 
Hx B. Furthermore, by (|A.4p and (jA.ip . for e i?*, 

<Tlr^x*,rlr^y*>^^ = <:c*,rlr^y*> = E{x*{X)y*{X)). (A.5) 

The operator T^Tyr and the Hilbert space determine each other; more 
precisely, we have the following. 

Theorem A. 3. // X and Y are B-valued random variables such that 
T^,Ty : B* L2(P) and T^,Tp : L^{¥) B, then the following are 
equivalent: 

(i) Hx = Hy (as vector spaces with given inner products). 

(ii) The unit halls Kx and Ky are the same (as subsets of B). 

(iii) T^T^=T*Ty. 

(iv) E{xf{X)x^{X)) = E{xl{Y)x^{Y)) for every e 5*. 

(v) EX®^ = Ey®^, assuming that either both moments exist in Pettis 
sense, or that B is separable (in which case the moments exist at 
least in Dunford sense). 



Proof, (i) (ii) Each Hilbert space determines its unit ball. Conversely, 



the unit ball determines the space and its norm, and thus the inner product 
by the polarisation identity = j{\\x + — l|x — yp). 



(i) =^ (iii) Immediate from (jA.4p . 
(iii) =^ (i) T^T^ determines both the set im(T|-Ty) ^ Hx and, by 
dA^, the inner product in Hx restricted to this subspace; since im(r|-Ty) 
is dense in Hx, and Hx continuously included in i?, this determines Hx- 
By dAl]). 



(iii) 






(iv) 







IV 



(v) By Corollary EH or □ 



As said above, T^T^ can be seen as the second injective moment of X\ 
by Theorem IA.3( also the space Hx can be seen as a manifestation of the 
second injective moment. 

The space Hx is important for the law of iterated logarithm in Banach 
spaces, since the unit ball Kx turns out to be the natural limit set, see 
Ledoux and Talagrand [42, Chapter 8] for a detailed discussion. In particular 
(43 . Theorem 8.5], if B is separable and Sn = -^i where Xi are indepen- 
dent copies of X, with E X = 0, and further the sequence Sn/ log logn is 
a.s. relatively compact (which holds under rather general conditions, but not 
always), then its set of limit points is a.s. Kx- See also [H, 0] for exceptional 
cases where Hx still is important. 
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Example A. 4. Let W e C[0, 1] be standard Brownian motion, see Exam- 
ples 15.121 and 111. Hi By (15. 5p and an integration by parts, 

Txifi) = C W{t) dfi{t) = C fi[t, 1] dW{t). (A.6) 
Jo Jo 

Hence Im(Tx) is the space of stochastic integrals S^q g{t) dW{t) where g is 
a deterministic function of the type g{t) = ii[t, 1] with fi e M[0, 1], i.e., a 
function g on [0,1] of bounded variation. Since |1 ^5 dVF||2,2(p) = ||<7|Il2|-o^i] 
and the functions of bounded variation are dense in L^[0, 1], it follows that 

lMT^=l^j\dW:geL\0,l]Y (A.7) 

Moreover, by (j5.6p . 

Tl ( g dw) (t) = (w{t), J^' g{s) dW{s)^ = £ g{s) ds. (A.8) 

Hence the reproducing Hilbert space Hx is given by 

i^x = |J^(s)ds:5eL2[0,l]|; (A.9) 

equivalently, this is the space of absolutely continuous functions / on [0, 1] 
with /(O) = and /' e -^^^[0,1}; the norm is ||/'||2,2. This is the usual 
Cameron-Martin space, see e.g. [33, Example 8.19]. (See [13, Section Vni.4] 
for a generalization to more general Gaussian processes.) Note that the law 
of iterated logarithm for Brownian motion [ss',. Theorem 27.18] says that the 
cluster set of Ys{t) := W{st) /^/2slog]ogs e C[0, 1] as s — > oo a.s. is the unit 
ball Kx of Hx', this is another example of the connection between the law 
of iterated logarithm and the reproducing Hilbert space. 

Remark A.S. The name reproducing Hilbert space is in a more general 
context used for a Hilbert space H of functions on some set T such that 
each point evaluation / fit) is a continuous linear functional on H, 
see Aronszajn [3] and e.g. [371, Appendix F]. The definition implies that 
for each t e T there is an element Kt e H such that /(t) = (/, Kt)H 
for all f e H. In particular, Ks{t) = (^Ks,Kt)H] the symmetric function 
K(s, t) := Ks{t) = {Ks,Kt} on T x T is known as the reproducing kernel, 
see [371, Theorem F.3] for some of its basic properties. 

We can connect the space Hx constructed above to this general setting by 
taking T = B* and regarding elements of B as functions on B* in the usual 
way, regarding x e B as the function x* {x, x*). The point evaluations 
are thus the elements x* e B* , which are continuous on Hx £ B, and ()A.4p 
shows that 

K,^ = T^Txx^; (A.IO) 
hence the reproducing kernel is, using (IA.5p . given by 

i^(x*,y*) =E(x*(X)y*(X)). (A.ll) 
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In other words, Hx is a reproducing Hilbert space of functions on B* , and 
the reproducing kernel equals the weak second moment of X given by (11.11) . 

We mention also that the construction above of Hx is an instance of [371, 
Theorem F.5], taking (in the notation there) T = B* , hx* = x*{X), and 
H = Im(Tx), the closed linear subspace of L^(P) spanned by : x* e 

B*}. (Then the operator R defined there equals our by (|5.3p and (|5.2p .) 

We finally mention the following result, adapted from [42, Lemma 8.4]. 
For simplicity, we consider only separable B. (Note that then : L^(F) 
B by Remark 15.111 ) We do not know whether the result extends to non- 
separable spaces. 

Theorem A. 6. Suppose that B is separable and that x*{X) e L^(P) for 
every x* e B* . Then the following are equivalent. 

(i) Kx is a compact subset of B. 

(ii) Tx ■ B* —>■ L^(P) is a compact operator. 

(iii) : L^(P) B is a compact operator. 

(iv) T^Tj^ : B* B is a compact operator. 

(v) //x* ^ in B*, then Ex*(X)2 ^ 0. In other words, Tx : B* ^ 
L^(P) is sequentially weak* -norm continuous. 

(vi) The family {x*{X)'^ : \\x*\\ ^ 1} of random variables is uniformly 
integrable. 

(vii) The infective moment E X®^ exists in Pettis sense. 



Proof, (i) (iii) By the definition of compact operators (which says that 



Kx is relatively compact, i.e., Kx is compact) and the fact shown above 

that Kx is a closed subset of -B. 

Standard operator theory [l^, VI. 3. 4]. 
Immediate. 



ui, 



m, 



(iv) 



(iv) =^ (v) 



Let X* ^ in 5*. If ^ e L2(P), then T^i e 5, and 
thus <rxx*,0 = «,?10 0; hence Tyx* ^ in L2(P) and thus 
ri-Txx* in B. Moreover, the sequence x* is bounded by the uniform 
boundedness principle since it is weak* convergent. Since T^T-^ is a compact 
operator, it follows that the sequence T^Txx^ is relatively compact in B, 
and thus the weak convergence T^Txx^ — ^ implies norm convergence, 
i.e., ||r|-Txx*|| —>■ 0. Consequently, (|A.ip implies 

Ex:(X)2 = (T^Txxlx:) ^ \\T^Txx*Jb\K\\b* - 0. 



(v) =^ (ii) : Let K* be the closed unit ball of B* with the weak* topology; 
then K* is compact by Alaoglu's theorem [isl . Theorem V.3.2]. Moreover, 
since B is separable, K* is metrizable, and thus sequential continuity on 
K* is equivalent to ordinary continuity. Hence (v) implies that Tx is a 
continuous map from K* into L^(P). Consequently its image is compact, 
which means that Tx is a compact operator. 



(ii) =^ (vi) By (ii) the family {x*(A) : ||x*|| ^ 1} is relatively compact 
in Zr(P), which implies that {x*(A)^ : ||x*|| ^ 1} is uniformly integrable. 
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(For example because / i— > is a continuous map L^(P) —>■ L^(P), so the 
latter family is relatively compact in L^(P), and thus uniformly integrable 
by [13, Corollary IV.8.11].) 



(vi) =^ (v) : If 0, then a.s., and thus uniform 

integrability implies Ex*(X)^ 0. 



(vi) (vii) By Theorem 16. 1£ pTl^a) □ 



Appendix B. The Zolotarev distances 

The Zolotarev distance CsiX,Y), where the parameter s > is a fixed 
real number, is a measure of the distance (in some sense) between the distri- 
butions of two random variables X and Y with values in the same Banach 
space B. We give the definition of Cs in Subsection IB.2I below and explain 
the connection to tensor products and moments, but first we recall some 
preliminaries on Frechet derivatives in Subsection lB.il 

Note that Cs{X, Y) depends only on the distributions C{X) and C{Y); we 
may write (siJ~-iX), C{Y)) = (s(X,Y), and regard Cs as a distance between 
probability distributions on B, but it is often convenient to use the notation 
Cs{X, Y) with random variables X and Y. 

It is important to note that Cs{X,Y) may be infinite. Hence defines a 
metric only on suitable classes of probability distributions on B, where we 
know a priori that (^s{X,Y) < oo. 

B.l. Frechet differentiablity. We recall some well-known facts about de- 
rivatives of Banach space valued functions, see e.g. [lH for details. 

Let B and Bi be Banach spaces, and let U he a non-empty open subset 
of 5. A function f : U ^ Bi is (Frechet) differentiable at a point x e U if 
there exists a bounded linear operator T : B ^ Bi such that 

f{y) - fix) - T{y -x) = o{\\y - x\\) (B.l) 

as y ^ X. The linear operator T e L{B; Bi) then is uniquely determined; it 
is called the derivative of / at x and is denoted by f\x) or Df{x). 

The function f : U ^ Bi is said to be differentiable if it is differentiable 
at every x e U. In this case, the derivative /' is a function U — > L(B; Bi). 
If furthermore /' : U ^ L{B;Bi) is continuous, / is said to be continuously 
differentiable. 

Since L{B;Bi) is a Banach space, we may iterate: If the derivative 
f : U —>■ L{B;Bi) is differentiable, its derivative /" is called the second 
derivative of /, and so on. Note that /" then is a function on U with values 
in L{B; L{B; Bi)) = L{B'^;Bi), so the second derivative f"{x) at a point 
X e f7 is a bilinear map B x B — > Bi. More generally, the A;:th deriva- 
tive f^^\x), if it exists, is a A;-linear map 5^- ^ Bi. It can be shown [III, 
Theoreme 5.1.1] that this map is symmetric. Since L(S^; 5i) ^ L{B®'';Bi) 
by an extension of Theorem 14.61 we can also regard the A;:th derivative 
f^^\x) as a (symmetric) linear map B'^^ — > Bi. We may take advantage of 
this by writing f^^\x){y, ... ,y) as f^''\x){y®''). 
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C^{U; Bi) is defined to be the linear space of all continuous functions / : 
U —>■ Bi, and C^{U; Bi) is the linear space of all continuously differentiable 
functions f : U ^ Bi. More generally, C^{U]Bi) is the linear space of all 
k times continuously differentiable functions U ^ Bi; this may be defined 
formally by induction for ^ 1 as the space of all differentiable functions 
f -.U Bi such that /' e C''-^{U; L{B; Bi)). 

Note that (IB.lh implies continuity at x; thus a differentiable function is 
continuous. Hence, Bi) =3 C^fc/; Bi) =3 C^{U] Bi) ^ ■ ■ ■ . 

For < 7 ^ 1, we define Lip^(C/ ; Bi) to be the linear space of all functions 
/ : [7 — > i?i such that 

11,11 \\f{x)-f{y)\\ 
WfWup^ := sup — I 



m ■ 



(B.2) 

7 with m e {0, 1, 2 . . . } 



is finite. More generally, for s > 0, we write s 
and < 7 ^ 1 (thus m = \s] — 1) and define 

Up,iU;Bi) := {/ e C""([/; Bi) : e Lip^(C/; L(i?-; i^i))} 

with 



/IlLipj 11/ 



(m) 



Lip 



(B.3) 



(B.4) 



It follows from a Taylor expansion [ill . Theoreme 5.6.1] at that if / e 
Lip^(i?; Bi), then 



m ^ 



(B.5) 



fc=0 



where the implicit constant is universal (it can be taken as 1). (The term 
with A; = in ()B.5P is just the constant /(O).) In particular, 

||/(x)|| = 0(1 + xeB. (B.6) 

Note that |[ ][Lip^ is only a seminorm. In fact, we have the following. 

Lemma B.l. Let f : U Bi where U B is connected, and let s > 0. 
Then the following are equivalent, with m = \s] — 1, 

(i) ll/llLip, =0. 

(ii) Z^™") is constant. 

(iii) (x) =OforallxeU. 

(iv) f{x) = Xifc^o Q^A;(2^! • • • where e L{B^;Bi) is a k-linear map. 
It follows from ^[Bl\t and ([Rij) that 



Proof. 

l/l|Lip^ 



(i) 




(ii) 









1/ 



(m) 



Lip^ 







/M(x) = /^-^(y)for any X, yet/. 



p(m) 



(ii) =^ (iii) : Obvious by the definition of the derivative. 



(iii) =^ (iv) Suppose for simplicity that U is convex. (The general case 



fo: 

and then 



lows easily, but we omit this.) By a translation we may assume that e [/, 
follows from Taylor's formula ll|, Theoreme 5.6.1]. (We have 



IV 
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(iv) =^ (ii) It is easily seen by induction that if each ak is symmetric, 



as we may assume by symmetrization, then for 1 ^ j ^ m, 

k\ 

f^^\x){yi,...,yj) = ^ — — — afc(x,...,x,yi,...,yj) 

k^j ^ 

(with k — j arguments of Ok equal to x); in particular, f^^\x) = ml am, 
which does not depend on x. □ 

B.2. Zolotarev distances. We now define the Zolotarev distanc e C , as 
follows, for any s > 0; see Zolotarev jH, 67, 68, [6§] and e.g. H, 49, [lo] for 
further details. 

Let i3 be a Banach space, and suppose that every bounded multilinear 
form — > M is S^-measurable (i.e., measurable for the product cr- field B^), 
for any k ^ 1. (For k = 1, this holds by the definition of Bw) If B is sepa- 
rable, this assumption always holds, since every bounded multilinear form is 
continuous and thus Borel measurable on B^; moreover, when B is separable 
the Borel c-field on B^ equals the product fi- field B'' and B = Byj. The main 
example with B non-separable is D[0, 1], where Byj = T> hy Theorem 115.51 
and every multilinear form is P-measurable by Theorem 115.81 (Another ex- 
ample is 00(5"), where B^ = C by Theorem 112.41 and every multilinear form 
is C- measurable as a consequence of Lemma 112.21 ) 

We let Lip^(i?; M) be the set of all ;Bu,-measurable functions in Lipg(i?; M); 
this is evidently a subspace of Lip^(i?; M). If i? is separable, then Lip^(i?; M) = 
Lip(i?;]R), since every function in Lip^(i?;M) is continuous and thus Borel 
measurable, and B = Bw 

Let X and Y be two weakly measurable i?-valued random variables, and 
suppose that ]E||Xp, ]E||y ||* < 00. (We use upper integrals here, since the 
norms are not necessarily measurable.) Define 

UX,Y) := sup{|E/(X) - E/(y)| : / e Lip^(i?;R) with ||/||Lip, ^ l}. 

(B.7) 

By assumption, / is ;Btt,-measurable, and thus f{X) is measurable. More- 
over, by (|B.6p . \ f{X)\ = 0(1 + \\XY) and by assumption E||Xp < 00; hence 
E|/(X)| < 00. Similarly, E|/(y)| < 00, and thus |E/(X) -E/(y)| is 
well-defined and finite for every / e Lip^(i?;M). Thus C,s[X,Y) is a well- 
defined number in [0, oo]. Moreover, E f{X) and E fiY) depend only on the 
distributions C{X) and C{Y), and thus C,s is really a distance between the 
distributions; we may write Cs(>C(X), /3(y)) = C,s{X,Y). 

By (|R7l) and homogeneity, for any / e Lip^(S;M), if Cs{X,Y) < 00, 

|E/(X)-E/(y)| ^ \\f\\up^UX,Y). (B.8) 

It is clear that CsiX,Y) ^ with ("^(X, X) = 0, and that is symmetric 
and that the triangle inequality holds. Moreover, if x* e B*, then e'^ e 
Lipg{B;C) for any s > as is easily seen [gl]. Hence, by taking real and 
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imaginary parts, (1B.8|) implies that if (siX,Y) = 0, then 

Ee^^*W =Ee'^*(^) (B.9) 

and it is well-known that this implies that C{X) = C{y) on Bw (In fact, 
()B.9p implies, by replacing x* by tx* with t e M, that x*(X) and x*(Y) 

have the same characteristic function, and thus x*{X) = x*(Y) for every 
X* e B* . This implies C{X) = C(Y) on Bw as seen in Theorem 117.31 and its 
proof.) Consequently, is a metric on any set of probability distributions 
on {B,Bw) such that Cs is finite. 

However, for s > 1, l^siX,Y) may be infinite. The following lemma says 
exactly when Q is finite. 

Lemma B.2. Suppose that X and Y are weakly measurable B-valued ran- 
dom variables such that ]E|[Xp, E||yp < oo. Then the moments EX®^ and 
]£y®fe exist in Dunford sense for 1 k ^ m = \s] — 1, and the following 
are equivalent. 

(i) Cs{X,Y)<^. 

(ii) E,a{X,...,X) = E,a(Y, . . . ,Y) for every k = l,...,m and every 
a e L{B^;M.). 

(iii) EX®'' = EY®'' /or 1 ^ ^ m. 



In particular, if < s ^ 1, then (ii) and (iii) are vacuous, and thus 
Cs{X, Y) < CO for all such X and Y. 

Proof. If a e L(S^;M) is any A;-linear form, then x ^ a{x, . . . ,x) is B^j- 
measurable by assumption and thus a{X, . . . , X) is measurable. Further- 
more, if 1 ^ A; ^ m < s, then \a{X, . . . ,X)\ ^ ||a||||Xp = 0(1 + ||Xp), and 
thus a{X, . . . , X) is integrable. Theorem 16.151 shows that EX®^ exists in 
Dunford sense for 1 ^ k ^ m, and the same holds for Ey®^. 

(i) =^ (ii) : Suppose that a e L(B'^;M) with k ^ m, and let f{x) 



a{x, . . . ,x). By assumption, / is i3i„-measurable, and by Lemma IB. II / e 
Lip^(S;M) with ||/||Lip^ = 0. Consequently, / e Lip^(S;M), andif Cs(^,^) < 
ao, then (ifesl) yields Ef{X) = Ef(Y). 



]!)] Suppose that / e Lip^(S;M) with ||/||Lip, ^ 1- By (iRSll . there 

exist A;-linear forms = f^''\0)/k] e L(i?^;]R) and a function g : B M 
with \g{x)\ ^ ||x||'^ such that 

m 

f{x) = Y,Mx,---,x)+g{x). (B.IO) 

fe=0 

(Here, = /(O) is just a real constant.) By assumption, f{X) and all 
ak{X, . . . ,X) are measurable, and thus g{X) is measurable, and similarly 
g{Y) is measurable. Hence we can use the decomposition (IB.lOp and obtain 



using (ii) (and the fact that ao is a constant), with all terms finite by the 
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assumptions E||Xp, E||y ||* < oo, 
\Ef{X)-Ef{Y)\ 

m m 

= Y,^MX, ■ ■ ■ ,X) +Kg{X) ~ J]EakiY, . . . ,Y) ~Eg{Y) 

fc=0 fc=0 

= \Eg{X) -Eg{Y)\ ^ E|c/(X)| +E\g{Y)\ ^ + ]E||y 

Taking the supremum over all such / yields 

^ ]E||x||^ + E||y||' < 00. (B.ii) 



(ii) (iii) This is Corollary 16.171 □ 

Example B.3. IfO<s^l, then Lemma lB.21 shows that is a metric on 
the set of all probability distributions on [B, Bw) with a finite s:th moment 
of the norm E||Xp. 

If 1 < s ^ 2, and we still assume E||X||'^, E||y|['' < oo, Lemma [8.21 shows 
that CsiX,Y) < 00 if and only if EX = EY. Hence is a metric on the 
set of probability distributions with E||X||* finite and a given expectation. 
In this case it is natural to work in the set of probability distributions with 
expectation 0, which easily is achived by subtracting the means from the 
variables, so this is no serious restriction. 

The next case 2 < s ^ 3 is substantially more complicated. Lemma IB. 21 
shows that we need not only EX = EF but also EX®^ = EY^^. For 
real-valued random variables, it is standard to obtain this by considering 
the standardized variable (VarX)^^/^(X — EX). This extends to finite- 
dimensional spaces, where VarX is the covariance matrix, see e.g. j48| , but 
not to infinite-dimensional ones, and this is a serious problem when using (^s 
with s > 2 in Banach spaces. Nevertheless, it is at least sometimes possible 
to modify the variables to achieve the desired exact equality of the second 
moments, see e.g. |4^, and results like Theorems 11.11 and 11.31 then are useful. 

For s > 3 we need not only equal first and second moments, but also 
equal third moments EX®^ = EY®^. This can in general not be achieved 
by any norming, not even for real-valued random variables. If the variables 
are symmetric, however, all odd moments vanish. Thus, for s ^ 4, (^^ is 
a metric of the set of all symmetric probability distributions with a given 
second projective moment, and E||Xp finite. It seems likely that there might 
be applications with symmetric random variables and 3 < s ^ 4, but we do 
not know of any such cases, or of any other applications of with s > 3. 

The main use of the Zolotarev distances is to prove convergence in dis- 
tribution; the idea is that if {Xn)^=i is a sequence of i?-valued random 

variables, we can try to prove X„ -—>■ X (for a suitable random variable X 
in by first proving 

C(X„,X)^0. (B.12) 
It turns out that (|B.12p is by itself sufficient for convergence in distributions 



in some Banach spaces, for example when S is a Hilbert space 3l|, ll9|, but 
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not always, for example not in C[0, 1] where extra conditions are needed 



Example B.4. One example where this approach has been particularly suc- 
cessful is the contraction method used to prove convergence in distribution 
of a sequence Xn of random variables when there is a recursive structure of 
the type 

K 



Xn = 2 ^r,nXll + 6„, (B.13) 



r=l 



where {X^^^)f^Q, . . . , {xf ^)f^o are i.i.d. copies of and /, 

and bn are given random variables independent of all Xj . (The idea is, 
roughly, to first find a good candidate X for the limit by formally letting 
n ^ 00 in (IB.lSp . assuming that Aj-^n, Ir,n and 6„ converge in some suitable 
way. Then one uses (fBl3]) to obtain a recursive estimate of the distance 

Cs{Xn,X), and use this to show that Cs{Xn,X) — > 0.) This method was 

introduced for real- valued random variables b y R osier [53 . Issl . Is^ . and has 
been extended to variables with values in [471, 148L L^O, 1] [251], Hilbert 



r,n 



spaces [19], C[0, 1] and D[0, 1] [491, |60!]; see further [49|, l6fl] and the further 



references given there. These papers use not only the Zolotarev distance 
Cs considered here but also some other probability metrics; nevertheless the 
Zolotarev distances are essential in several of the applications. Moreover, it 
is easily verified that for any real constant t, 

Cs{tX,tY) = \t\Xs{X,Y) (B.14) 

and, for any bounded linear operator T e L{B; B), 

Cs{TX,TY) ^\\TrUX,Y). (B.15) 

In applications, these relations are typically applied with \t\ or ||T|| small, 
and it is then advantageous to take s large. In fact, in some applications 
(see e.g. |49j]) one is forced to take s > 2 in order to obtain the required 
estimates, and then, as seen in Lemma IB . 2 1 and Example IB.3|, it is essential 
to have (or arrange) equalities of the second moments EX®^ = EX®^ in 
order for (!^s[Xn,X) < oo (which is necessary in order to even start the 
recursion sketched above). 
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